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FOREWORD 


The friends and well-wishers of the Indian Statistical Institute have laid 
those connected with the Institute under a load of gratitude by conceiving of and 
executing this plan of bringing out a volume of essays to be presented to Professor 
P. C. Mahalanohis on his Seventieth birthday in June, 1963. To one like me who can 
claim to have been a close friend of Professor Mahalanohis for over 40 years and who 
has had the privilege of working with him in guiding the growth and development 
of the Institute for the last 18 years, this gesture of regard and good-will is especially 
gratifying, as well as appropriate, for the attainment of the throe-score years and 
ten span by Professor .Mahalanohis happens to mark the consummation of a most 
remarkable period of achievement in the life of this eminent scholar and scientist, 
restless visionary and planner. 

Mahalanohis had left Cambridge, with a brilliant degree in Mathematics 
and Physics, by the time I was admitted there in 1915. But a close friend of his 
who continued his studies became a close friend of mine also, and through him I came 
to know Mahalanohis sufficiently well to stay as his guest in Calcutta in October, 
1920, when I visited that city to appear in some Oriental Languages examination. 

It was during that visit that I learnt of the high standing of the Mahalanohis 
family in Bengalee society, as weU as getting a glimpse of Mahalanobiss interest in 
statistics—connected at that time with meteorology, purely as a powerful side 
interest of a professional teacher of physics. Mahalanohis introduced me to his 
aunt, a daughter of Keshab Chandra Sen, and in his company I called on Dr. Brajcndra 
Nath Seal and Dr. Nilratan Sircar. A year later, I visited Calcutta again and got 
to know Srimati Nirmalkuraari Maitra, then Mahalanobiss ftanede and soon after 
Mahalanobis s wife. Dr. Heramba Chandra Maitra, her father, was a strict Bralimo 
and there was much ado over the pro,»osed mode of marriage ceremony but love 
triumphed in the end. 


I learnt of the difficulties that had been overcome only years later, as between 
Inland 19301 had very little contact with the Mahalanobisos. The threads of friend- 
ship, not any the worse for desuetude were resumed in Simla where I came to be 
posted as Joint Secretary to the Government of India in the Department of Education 
Health and Lands and whither Mahalanohis had come to pereuade the Government 
of Ind a to give h,m a small grant-not of more than four digits-for ,level,mi,m 

S JU ' St ' Ca l “ b0ratoly and Ins,ltutc - For, in the meanwhile tins was the stable but 
unsubstantial form his interest in statistics had taken, an interest which had grown 
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into a passion as the years went by ami the time for his retirement from his official 
post of Professor of Physics at the Presidency College. Calcutta drew nearer. Some 
space, sparing which was becoming increasingly difficult to an expanding department, 
had been permitted to be used for the purposes of the Statistical Institute and 
Laboratory. 

My joining the Reserve Bank of India in 1939 as Secretary, to rise to be 
Deputy Governor (1941) and Governor (1943) marked a turning point in my own 
relations with Mahalanobis and my interest in his extra-professional work. 
The Reserve Bank top-level staff, with Headquarters in Bombay, spends about 
three months of the year (from mid-November to mid-February) in Calcutta, in 
order to maintain contact with that of other great industrial and commercial capital 
of the country. My duties therefore involved a three-month sojourn in Calcutta 
and far more extended opportunities of keeping up contacts with the Maludanobises. 
I had taken the opportunity of this sojourn to learn a little Bongali, in order to 
know better my many friends in Bengal—from Cambridge days, principally. And 
this forged another link in my friendship with the Mahalanobises. as I discovered how 
closely they had been associated with Rabindranath Tagore and Santinikotan in 
its early days. Mahalanobis had been Secretary of Visva-Bharati and Rani (the name 
by which Tagore called Srimati Nirmalkumari Mahalanobis) a deeply devoted 
ministering angel to the Poet. 

Many a Sunday I spent with the Mahalanobises. upto 1942, in a house beyond 
Baranagore Railway Station and after 1942 in 204 Barrackporc Trunk Road, the 
present somewhat bewildering Panch-Mahal like house. Indeed, I was one of those 
who strongly advised the purchase of that property—during the war—as I felt attracted 
by its two tanks and gardenland. mangoes predominating (Amrapali was the apposite 
name given to it by Rabindranath Tagore). The war led to many profound 
changes in the location and organization of work of the Institute. Some staff had 
to be located in far away Giridih in the Santhal country. The Presidency College 
became less and less of an asylum and the precincts of Amrapali took up the strain. 

It was soon after my joining the Reserve Bank that I became a member 
of the Indian Statistical Institute, to become its President in 1944. Although I have 
studied lower mathematics it is not a subject I am at ease in or have a talent for, 
and my only connection with statistics had been carrying out random agricultural 
crop sample surveys, after Hubhack. as a Settlement officer in Raipur in Madhya 
Pradesh (then Central Provinces and Berar) between 1926 and 1931, as a cross check 
on soil classification, correlated to soil analysis, and rent-rates fixed by me. However, 
increasingly I felt a sense of involvement in Mahalanobis s work in statistics and a 
growing desire to help him in obtaining financial support from the Government of 
India. As Deputy Governor and later Governor of the Reserve Bank of India, I had 
some influence with the Finance Ministry and felt I should use it in what appeared 
to me to be a decidedly deserving cause. 
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But statistics was not the only bond between the Mabalanobisos and myself. 
Apart from their special relations with the Poet. I discovered Mahnlanob.s h deep 
interest in the social and intellectual movements in Bengal, especially in the life and 
work of Raja Ram Mohun Roy, and 1 learnt of his great competence as a speaker 
and writer of Bengali. Tagore become more and more a powerful theme of talk 
with us—the room reserved for him in Amrapali. from which the Poet could greet 
the morning sun if ever he stayed with them; the numerous tours in different parts 
of the world in which the Mahalanobises had accompanied the Poet, incidents of these 
travels that it was a pleasure to recall, particularly the triumphs; the Poet’s sense 
of humour; his amazing speed in com|»osing poetry, often a flow like that of the great 
river in a sailing boat on which he had loved to write; and the Poet's many letters 
to Rani. 

It was inevitable that the Mahalanobises and I should make plans for me to 
pay my respects to the Poet, and this was hastened by his illness at Santinikctan. 
The Mahalanobises and I went to the Abode of Peace in February 1011. just for a day 
or two. I ventured to take a small offering, in the shape of a poem in Sanskrit, which 
the Poet received graciously and in return for which at my request lie rend out one 
of his own ( Abiibhavo ). selected by Rani Mahalanobis. Alas, that was the fust 
and the last time that I was to sec the Poet. I returned to Bombay, to my 
duties in the Reserve Bank, and in August 1041 the sad tidings reached me that 
the Poet had passed away. 

I became the Governor of the Reserve Bank in February. 1013 with n more 
perceptible capacity to interest the Government of India in helping the Indian Statis¬ 
tical Institute, and in 1045 the Education Ministry agreed to make its first large and 
regular grant of Rupees Five Lakhs to the Institute for its Research and Training 
School. For Mahalanobis the period after the end of the war was one of more 
frequent professional trips abroad—he had in the meanwhile been made n Fellow of the 
Royal Society of U.K. for his work on largo-scalo agricultural sample surveys— and 
had also been elected a member of the International Statistical Institute. It was 
about this period that he resolved in his mind and discussed with me his idea of 
initiating a National Sample Survey as well ns his growing interest in Statistical 
Quality Control. 

This latter interest matured in the shape of a plan to invite Dr. Walter 
Shewhart, Director of the Research Laboratory of the Bell Telephone Co., the Father 
of Statistical Quality Control to India, in an effort to arouse interest in the movement 
in the business world of India. This effort had the welcome support of Dr. Lai Verman 
of the Indian Standards Institution and took shape in 1948. Dr. Walter Shewhart, 
accompanied by his wife Edna Shewhart. came to India, stayed in Calcutta with the 
Mahalanobises at Amrapali and in Bombay with me at the Reserve Bank House. 
Whilst the visit sowed the seed of statistical quality control in India, which after a 
late germination is at last showing signs of growing into a tree of considerable size, 
it laid the foundation of a deep and abiding friendship between the Shewharts and tho 
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Mahalanohises on one hand, and the Show-harts and myself on the other, a charmed 
circle to which my wife. Srimati Durgabai Deshmukh, was admitted on our marriage 
in January. 1953. Edna is didi to both Rani and Durgabai. and the Shewhart 
home in New Jersey is our American home. 


Soon after relinquishing the Governorship of the Reserve Bank in 1919, 
I was appointed, on the suggestion of the late Dr. John Matliai, then Union Finance 
Minister. Financial Ambassador in U.S.A. and Europe to the Government of India, 
and in that capacity accompanied Prime Minister Jawaharlal Nehru in part of his 
travels on his first visit to the U.S.A. in October-November 1949. Soon after that 
T was called to Delhi for consultations, but stayed to organize the Planning Commission 
for the Prime Minister and to become the Union Minister of Finance in May 1952 
ns a result of a concatenation of events which this is not the place or occasion to 
elaborate. 


It is necessary to state at this stage that Mahalanobis had known Shri Jawa- 
harial Nehru and had had occasion to inform him of what he had been doing to 
promote statistics in India. Once. I remember. Shri Nehru had come to Bombay 
to speak on South and South-East Asia and International Relations before the Bombay 
branch of the Indian Council of World Affairs. That evening I was invited to dine 
with Shri Nehru by his sister Srimati Huthee Singh, and I had occasion to refer to 
Mahalanobis's work for statistics and to discover that Shri Nehru was appreciative of 
it and conscious of the need to encourage it. This friendly interest was to bear fruit 
later in the appointment of Mahalanobis as Statistical Adviser to the Government 
of Tndia by Prime Minister Nehru. 


Mv coming on the scene as Minister of Finance led to many important 
developments of significance to the growth of the country's statistical apparatus, 
developments which would not have been possible but for Prime Minister Nehru's 
awareness of the role of statistics in planned economic development. The institution 
of a Central Statistical Office, the establishment of the National Sample Survey, 
the regular annual compilation of the National Income Report, with intensive statistical 
investigations within these fields, whenever and wherever required, the formation 
of a Stat istical Quality Control Policy Advisory Committee—all these were the product 
of the conjunction of the favourable circumstances which provided for the Indian 
Statistical Institute and Mahalanobis's ever-burgeoning ideas about the range of 
its potential services the strongest possible support in the Union Government, in 
the shape of the understanding by the Prime Minister of the importance of statistics, 
organized by a non-official, academically oriented and professionally competent- 
body like the Indian Statistical Institute. Apart from the proliferation of its activities 
as indicated above, this period (1950-1956) saw the strengthening of the Research 
and Training School and its diversification, including an International Statistical 
Training Centre, thanks to the support extended by the Government of India. 
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The recognition of the Indian Statistical Institute into an Institution of 
National Importance »>y means of a piece of legislation most underxtandingly |>ilole<l 
by the Prime Minister himself, about a couple of years ago. put the coping stone 
on this imposing edifice the rising of which owes so much to the enthusiasm, energy, 
initiative and professional competence of Mahalanobis. 

The Inst eight years have seen Mahalanobis grow into a figure of nalionul 
importance. His name leapt into prominence with his putting out a draft outline 
of the Second Five Year Plan in the beginning of IDr»0. Much preliminary work, 
including the labours of well-known foreign specialists, bad gone into this venture. 
That the Second Plan ns finally formulated contained much of the philosophy under¬ 
lying the Draft Outline testifies to the deep thinking that informed it. Since then 
Mahalanobis has had an assured place as a de facia member of India’s Planning Com¬ 
mission, and today he is in charge both of Science and Perspective Planning as a 
member of the Commission—still dc facto, because of the impossibility of divorcing 
him from his major interest: the Indian Statistical Institute. 

As President of the National Institute of Sciences of India. Mahalanobis had 
recently an opportunity to contribute to the stabilization of the resources of that 
eminent body, including the completion of its new home on Tilak Marg. New Delhi. 

It is inevitable that with his assured status in the world of science, statistics 
and planned economic development Mahalanobis should he frequently called upon 
to participate in international conferences or to advise Governments of developing 
countries. With no political predilections ho has friends all over the globe and easy 
access to scientific circles in the countries of both the Western and the Eastern Blocks. 
Scientists and academicians from both blocks respond to his invitation to spend some 
time at the Institute as visiting professors or experts. Ronald Fisher. Simon 
Ku/.nets. Richard Stone. Frank Yates. Norbert Wiener. John Strachey. J. K. 
Galbraith. Nicholas Kaldor. A. N. Kolmogorov. J. B. S. Haldane and numerous others 
have at one time or another helped in the work of the Institute and added new ranges 
or dimensions to it. Today the Indian Statistical Institute, with its journal Snnkhya 
its Ural Computer and its plans for the manufacture of calculating machines can 
claim to he in the forefront of scientific institutions of international importance and 
its School of Research and Training, under its highly competent Director. C. R Rno 
confers graduate and post-graduate degrees of B. Stat. and M. Stnt„ and research 
degree of Ph D. which arc recognized as the hall-mark of advanced training in 
statistical science and practice. ° 


W, h »“ h 8 remarkable achievements, Mahalanobis remains a modest man 
H,s absorption Ins work and his eatholieity of interest make him a man not too 
easy to get on with. He has no small talk and little capacity to compromise with 
unreason. But ho has no malice and no guile-indeed the intricacies of bureaucratic 
administrate 1 non-plus him-it is here that I have been able to help him a little 
and to make his path a little easier. 
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Mahalanobis’s eternal preoccupation with work suppresses a genuine capacity 
for affection—which in any case he would think it his duty to conceal—except towards 
canine pets. His absent-mindedness is often the butt of Rani's affectionate badinage. 
It is probal.lv true to say that without Rani’s unremitting help and attention 
Mahalanobis would make a mess of his foreign travel, leave things behind and catch 
the wrong planes. 


But all these arc superficial shortcomings. Functionally, he is extremely 
efficient and the volume and despatch of his work arc amazing. The proudest th.ng 
that a friend like me. of over 42 years of standing, can say .s that Mahalanolns and 
I have never had the slightest misunderstanding, not to speak of a quarrel. M J 
he be spared for manv more years to enrich the intellectual, aeadem.e and seient.fic 
life of the country and raise ever higher the stature of her statist.c.ans. 


C. 1). DESHMUKH 


RECOVERY OF ANCILLARY INFORMATION 

By D. BASU 
Indian Statistical Institute 

1. Introduction 

The main upsurge of late Professor R. A. Fisher's theory of Statist ieal Inference 
took place within a brief span of about l« years (192U-30) after the lirst worhl 
war. It was during this period that Fisher came out with the brilliant and now 
famous notions of (a) likelihood, (b) fiducial probability, (c) information and intrinsic 
accuracy, (cl) sufficiency and (e) ancillary statistics and recovery of information — 
concepts around which the superstructure of the theory is built. 

Many eminent statisticians and mathematicians have made detailed localised 
studies of some particular aspect of Fisher’s theory and some of these studies gave rise 
to important streams of fundamental research in statistical theory. The author (Basil, 
1939) made a very much localised study of the notion of ancillary statistics from 
tho purely mathematical point of view. This note is a follow up study of the 
oarlior paper (Basu, 1939) from tho statistical angle. Here wo discuss the very 
controversial subject matter of recovery of ancillary information through proper 
choice of ’reference sets.’ For the purpose of pinpointing our attention to the 
basic issues raised, we restrict ourselves to tho one-parameter set-up only. 

In the one parameter set-up Fisher defines an ancillary statistic as ono whose 
probability (sampling) distribution is freo of tho parameter and which, in conjunction 
with the maximum likelihood estimator of 0 (the parameter), is sufficient. Tho use of 
anoillary statistics has been recommended in two different inference situations namely 
the point estimation problems and the tosting of hypotheses problems. 

In point estimation problems tho use of a suitably chosen ancillary statistic 
is recommended in the situations where the maximum likelihood estimator T of U is 
not a sufficient statistic. The use of T as an estimator of 0 will then entail a certain 
loss of information which, according to Fisher, may be meaningfully (at least in the 
large sample case) measured, in some situations, as follows. Tho information contained 
in tho wholo sample X is defined as 

'<"> = «[- log / ( -X|0> I o] 

where f{x 1 0) is the frequency or density function for X. Similarly the information 
contained in a statistic T (which may be vector-valued) is measured by the function 

J(0) = e[- * r | o gs <I’| 0 )| «] 
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where g(t\0) is the frequency or density function for the estimator T. The difference 

MO) = 1(0) - J(0) 

may then be taken as a measure of the information lost. Under certain regularity 
conditions the following results may be proved : 

(1) A(0) > 0 for all values of 0; 

(2) MO) 3 0 if and only if T is a sufficient statistic; 

(3) it T together with the statistic }' be sufficient for 0 then the information 
contained in the pair (T, Y) is 1(0); 

( I) if Y be ancillary and the pair (T, Y) is sufficient then 

1(0) = E(J(0\ Y)\0) 

where J(0\y) is the conditional amount of information contained in T under the condi¬ 
tion that Y takes the value y, i.e. 

■/<«|y) - *’[ - ^ log f<T\i/. 0)| Y - y, 0] 

whore f(t\y. 0) is the condit ional frequency (density) function for T under the condition 
Y =* y. The relation (4) follows directly from the observation that the joint frequency 
(density) function h(l, y\0) of (T, Y) may lie factorized as 

h(l,y\0) = <j(y)f(t\y,0) 

where y(y) is the fl-frec ( Y being ancillary) marginal frequency (density) function for Y. 

Now, consider u situation where the maximum likelihood estimator T is not suffi¬ 
cient but where we are able to find another statistic Y whose marginal distribution 
is 0-free and which complements T in the sense that the pair (T, Y) is jointly suffi¬ 
cient. The statistic Y by itself contains no information about 0. But in a sense it 
‘summarises in itself’ the quantum of information A(0) that is lost in the use of T 
as an estimator of 0. The problem is how to recover this apparent loss of information. 
According to Fisher it is a mistake to calculate the information content of T with 
reference to the whole sample space, i.e. with reference to the marginal distribution 
of T. The appropriate measure of the information content of T is J(0\ Y) not J(0). 
Having observed T and Y we should consider the conditional distribution of T with 
the observed value of Y as the condition. We take as our ‘reference set’ not the whole 
sample space but the sub-sot of those sample j>oints that could give rise to tho observed 
value of tho ancillary statistic Y. 
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The following two quotations from Fishers writings emphasise the analogy 
that lie has reputedly drawn lietwecn the sample size and the aneillary statistic. 

“Having obfained a criterion for judging the merits of an estimate in the real 
ease of finite samples, the important fact emerges that, though sometimes the best 
estimate wo can make exhausts the information in the sample, and is equivalent for 
all future purposes to the original data, yet sometimes it fails to do so. but leaves 
a measurable amount of the informal ion unutilized. How ean we supplement our 
estimate so as to utilize these t«>o? It is shown that some, or sometimes all of t he lost 
information may be recovered by calculating what T call ancillary statistics, which 
themselves tell us nothing about the value of the parameter, but. instead, tell us how 
good an estimate we have made of it. Their function is. in fact, analogous to the part 
w hich the size of our sample is always expected to play, in telling us what reliance I.. 
place on the result,'■ (Fisher. 11135). 


When sufficient estimation is possible, there is no problem, hut the exhaustive 
treatment ot the eases in which no sufficient estimate exists is now seen to be an urgent 
requirement. This at present is in the interesting stage of tiring possible sometimes, 
though, so far as we know, not always. I have spoken of the sufficient estimates as 
containing m themselves the whole of the information provided l.v the data. This is 
not strictly accurate. There is always one piece of additional, or ancillary, information 
which we require, in conjunction with even a sufficient estimate, before this can he 
utilized. I hat piece of information is the size of the sample or. in general. «he extent 
Of"., ol«m«U.,„.| record We always need ... know 0.i« i„ order ... I,.. 

7 l,m "' c '*• » f '"king of <!»• sample for granted „„| 

.77 h ; |M ’ ix-ch.cr.ty of .he ca.es where ...ffieienl estimation i, h ,., 

the fae. that ,ho innate the,, contains all the farther information, re..red we 

like! .naif '' T'! taking the eatin.ale of .. 

ehhoo I h,r granted, have said that the peculiarity of these ease, was that. i„ a.l.li- 

. 0 , n,’ 8 m0rr r tl,e Si “ ° f the *" n P ,e f«r its complete interpre- 

tat on. .Ins reversed aspect of the problem is the ...ore frnitfnl of the two once we 

lm\« satisfied ourselves that, when information is l.w» # 1.;-1 . . . u 

the estimate of maximum likelihood. The eases j„ which" 

impossible are those in which, in n,dicing r 7 ."• “ 

among samples of the same size those from which more or le' ' : l,S "" 8 " is, ‘ 

tnation never modifies the value of our estimate- it Z Ancillnr>- mf« r - 

(Fisher. 1936). tunate. it determines its precision.” 

for granted in the subset adva ' ,ce and is ***«« 
vatious on a normal variable with unknown mean * and wl SSSZ 
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we sec no need to bother about any characteristic of the sample other than the sample 
mean x; but yet the fact remains that without some knowledge about n the maximum 
likelihood estimator x of 0 will be hardly of any use to any statistician. Along with 
the information that the sample is drawn from a normal population and the observed 
value of X, we need to know the value of the sample size «. The 'reliability’ of the 
estimator X is interpreted in terms of its average performance in repeated sampling 
with the lixed sample size n. 

% 

What happens if 'chance' plays (or is allowed to) a part in the determination 
of nl Suppose wo toss a true coin and, depending on whether the outcome 
is a 'head' or a’tail', wo draw a sample of size 10 or 100. It is easily verified 
that the sample mean x is still the maximum likelihood estimator of 0 but 
that it no longer is a sufficient statistic. It is the pair (x, a), where n is the 
(variable) sample size, that is sufficient for 0. Here n is an ancillary statistic 
taking the two values 10 and 100 with equal probabilities. Now, having drawn 
a sample of size n (which is either 10 or 100 ) and having estimated 0 by the 
sample mean 2 , how does the statistician rei»ort the reliability', the precision, the 
information content of the estimate? There is no gainsaying the fact that a sample 
of size 10 will lead to a less reliable estimate than a sample of size 100. Having 
drawn a sample of size 10 should the statistician turn a blind eye to the actual 
smallness of the sample size and try to figure out the long run performance of 
his estimation procedure in a hypothetical series of experimentations in which 
50% of the cases he draws sample of size 10 and the other 50% of the eases the 
sample size is 100? What should be the reference set for judging the performance 
characteristic of the estimator — the 10 dimensional Euclidean space tf, 0 or the 
union of /?,„ and R XWJ ? The author agrees with Fisher that, having drawn 
a sample with the ancillary statistic n = 10 , the statistician should judge (if at all 
ho must) the performance of the maximum likelihood estimator x in the condi¬ 
tional sample space (restricted reference set) R xo . However, the author feels 
that Fisher, in his writings on ancillary statistics and choice of reference sots, 
has pushed the above analogy with the sample size a little too far, thereby giving 
rise to some logical difficulties the real nature of which will be discussed later. 

In problems of testing Fisher uses ancillary statistics for the determination 
of the 'true* level of significance. Having selected the test criterion — a measure of 
the extent to which the observed sample departs from the expected one under the null 
hypothesis — the level of significance is the probability (under the null hypothesis) 
of gett ing a sample with a larger criterion score than the one actually obtained. In 
the presence of a suitable ancillary statistic Y, Fisher recommends that the level of 
significance of a test should In* computed by referring to the conditional sample spaco 
determined by the set of all possible samples for which the value of Y is the one pre¬ 
sently observed. 

The following example worked out in Fisher (1956, pp. IG.’l-GD) is reproduced 
here with quotations with the idea of bringing out the essential features of the method 
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of ‘Recover)' of Information' (as envisaged by Fisher in the context, of point estimation) 
through proper choice of ‘reference sets'. 

Example: Let us suppose that we have X pairs of independent observations 
on the pair (A', )') of positive random variables with joint probability density function 

- 9 ) 

V(x,!/ 10) = c 9 , x > 0. y > 0 , 0 > 0 . 

Let (A’*, I’,), i = 1,2, .... A\ be the X pairs of observations and 

let T - V- F./ZX, and U = x / 


It is easy to check that 


(i) T is the maximum likelihood estimator of 0, 

(ii) T is not sufficient for 0, 

(iii) the pair ( T , U) is jointly sufficient for 0, 

(iv) V is an ancillary statistic, i.e. the marginal distribution of U is 0-frcc. 


"Since the likelihood cannot he expressed in terms of only 0 and T, there 
will be no sufficient estimate, and some information will be lost if the sample is 
replaced by tho estimate T only.” 


The amount of information supplied by the whole sample (of X pairs of obser¬ 
vations) is 


1(0) * 2 N/0* 

while the amount of information contained in the statistic T is 


J(0) = 


2 X _2X 
0 * 2^+1 * 


"Tlu, loss of information is loss than half the value of a single pair of obser¬ 
vations, and never exceeds one third of the total available. Nevertheless its recovery 
does exemplify very well the mathematical processes required to complete the logical 
inference.” 


Here, V is the ancillary statistic and so we have to consider the conditional 
distribution of T given U. From this conditional distribution the conditional infer- 
mation content- of T works out as 


J(0\U) 


«* IQW) 


where K a and K t arc Bessel functions. 

1 " s "*» information content .7(0 1 U ) "depends upon the value of 

account of"™ a " ^ Varia,ions of U taken into 

2N/0 1 , 

tlic total amount expected on the average from N observations, none is now lost 
The information IS recovered and inference completed by replacing the distribution 
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«*| T for given size of sample .Y, by the distribution of T given U, which indeed happens 
not to involve .V at all. In fact. U has completely replaced N as a means of specifying 
the precision to he ascribed to the estimate. In both eases the estimate T is the same, 
the calculation of U enables us to see exactly how precise it is. not- on the average, 
but for the particular value of U supplied by the sample.” 


2. The sample size analooy 

This section is devoted to a detailed discussion on the oft-drawn analogy 
between the sample size and an ancillary statistic. While drawing the analogy 
Fisher seems to be always thinking of the sample size n as the only determinant, of the 
sampling experiment. The reliability of an estimate is assessed in terms of the average 
performance of the experimental procedure in a hypothetical series of experimenta¬ 
tions with the sample size n fixed at the level actually obtained in the sample at hand. 
Fisher always interpreted the reliability (information content, variance etc.) of an 
estimate in terms of the average performance of some well-defined experimental 
(estimation) procedure in some hypothetical sequence of experimentations. When 
Fisher talks of the reliability of an estimate the adjective ‘reliability is used only as 
a transferred epithet and is actually meant to be attached to the estimation procedure 
that has given rise to the estimate. 


In the example on page 10 the statistician (for some unknown reasons) 
decided to choose between a sample of size 10 or one of size 100 on the basis of the 
flip of a coin. Here a random choice is being made between two sampling experiments 
<5,„ and £ l00 with the associated sample spaces R l0 and /? l00 and the corresponding 
probability distributions. More generally, suppose &, is the sampling experiment 
corresponding to a sample of size v and suppose the observed sample size n is deter¬ 
mined by a 0-freo (parameter-free) chance mechanism. Once we recognize that the 
estimate T of 0 is generated by the random choice from the family (5,) of available 
experimental procedures we ought to transfer the reliability index of the chosen ex¬ 
periment <5,, to the estimato T. When the statistician is forced to make a selection 
from a family of available experimental procedures he should report the reliability 
of the procedure actually selected by him. The following example is somewhat 
more realistic than the one considered on page 10 . 


Example: Suppose, from a finite population of N units, wc draw a sample 

of size .v with replacements. Lot X v X t . X K Ik* the population values and * a . 

...,.r, the * sample values (arranged in order of their appearances). The problem 

is to estimate the population mean X = (X,d- \-X N )l.\ and the obvious estimate 

is the sample mean X = (r,+-r,)/s which has a standard deviation of <r]Vs where 
^ is t he population variance. But will it Ik* correct to recognize s as the true sample 
size ? Since the sample was drawn with replacements, it is plausible that some of the 
population units came repeatedly in the sample. In realistic sample survey situations, 
we can usually distinguish between the population units. Consider the extreme 
situation where all the 8 sample units happen to be the same (population unit). 
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Confronted with » situation like this thr statistician w«»uld surely hesitate 1 . h |m.h 
the reliability of his estimate as v/V*. It. this extreme ease the honest statist.<Ma., 
will have to admit that he had drawn all nnlueky sample wle.se effective s./e is on V 
I (and not s) and report the rolial.ility of his estimate as a (ami not trj Vx ). Mon- g-'"' 
rally, consider the situation where « is the numla-r of distinct units m the sample 

and xl xl .are the corresponding sample values (arranged say in an increasing 

order of their population unit-indices). It is easy to sec that the pr<.hability distri¬ 
bution of n involves only A’ and *. and since they are known constants, the statistic 
n is ancillary. It we detine ?* as 


r ('• O'" 


then it is well recognized (see Basil (IH.'.n) for a detailed diseussion on ibis] that 

. r' M ) is a sufficient statistic and that t" £(*| -t.O- Heme, by the 

Rao-Blaekwell theorem, .f* is la-ller than 7 as an unbiased estimator ol All light, 
we agree to estimate .Y by X 9 and forget all about X. But our troubles arc- not yet 
over. What is the standard deviation of x' i For a fixed «. the conditional distri¬ 
bution of (.#-* »•*) is the same as that of a simple random sample of size n from the 

population of .V values. We see then that the ancillary statistic " is really a sample 
size. When we draw a sample of size s with replacements and agree to take note of 

only the sufficient- statistic (jJ. xl .*;) we are effectively drawing a simple random 

sample of variable size a. If we denote by (» — I. 2. s) the experimental proce¬ 

dure of <1 rawing a simple random sample of size i from the population of .V units and 
by p i the para met er-free probability that u =- ». then the above experimental proce¬ 
dure is the same as that of selecting one of the experiments .... with proba¬ 
bilities p,. p,. p, (and then carrying out the experiment so selected). From what 

wo have said earlier, it then follows that we should assess the reliability of x * in terms 
of that of the experiment & n actually selected, i.c. V(x u ) should be reported as 


and not as 


iV-n <r 3 

Y-l N 



xY—n a 3 \ 
N -1 n /' 


( 2 . 1 ) 


( 2 . 2 ) 


Let us repeat once again that when reporting the reliability of an estimate 
we are actually saying something about the longterm average performance of some 
well-defined estimation procedure. Both (2.1) and (2.2) are reliability indices—(2.1) 
for the experimental procedure G n with a fixed n and (2.2) for the experimental proce¬ 
dure where a is allowed to vary (in the para meter-free manner described earlier) from 
trial to trial. We may briefly summarise the basic Fisherian point of view (in the 
present context) as follows : 

(a) Suppose a whole family {<5,,}. where y runs over an index set y, of statistical 
experiments is available any one of which may be meaningfully performed for the 
purpose of making a scientific inference about some physical quantity 0. 
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(l>) And suppose that the experiment that the statistician actually performs 
is recognized to he equivalent to the two-stage experiment of first selecting at random 
a point 1 in y and then performing the experiment S v . 

(c) Suppose, further, that the probability distribution of Y in X is 0-free. 

Under the above conditions, the true ‘reference set’ for the statistician is the 
experiment <S F (with its associated sample space ami probability distributions) and not 
the two-stage experiment described in (b) above. The reliability (information content, 
standard deviation, significance level etc.) of the inference made about 0 should be 
assessed in terms of the average performance characteristic of the inference procedure 
in a long hypothetical sequence of independent repetitions under identical conditions 
of the experiment g y (where Y is supposed to he held fixed at the particular point 
that obtains in the present instance). 

Under the above circumstances Fisher would like the statistician to say 
something to the following effect : "It was rather silly of me to let chance have a 
hand in the determination of the experiment Sy f° r me. But I now recognize that 
I have performed the experiment S r and see no reason whatsoever to fuss about the 
other experiments in the family [£„} that might have been handed down to me by 
chance. The inference that 1 make about 0 is the most appropriate one for the experi¬ 
ment S y , and the assessment of the reliability of my inference is made with reference 
to the experiment <g y alone." 

Now, let us consider a general inference situation ami see whether the above 
arguments hold in the presence of an ancillary statistic. Let & he an arbitrary statisti¬ 
cal experiment performed with a view to elicit some information about a physical 
quantity 0. From the mathematical standpoint we are then concerned with the 
trio(^E> yi' JO) where oV = { r } >* the sample space and yl = [A] is the <r-field of events 
on which the family 7° = of probability measures is defined. For the sake of 
simplicity, we ignore the possibility of nuisance parameters and we assume that 
different possible values of 0 arc associated with different probability distributions. 
Now, let Y be an ancillary statistic taking values in the space y. Corresponding to 
each point y in y we then have (under some regularity conditions) a trio (JV y , *>„), 
where £C y is the sub-set of points of iC for which Y = j and Jo y = {P$ is the family of 
conditional probability distributions on a <r- field of subsets of cp H . 

We have only to imagine a conceptual experiment g v that gives rise to the trio 
and the analogy that we have been trying to drive home is complete. The 
statistical experiment & is then equivalent to the two-stage experiment of first observing 
the random variable Y (whose distribution is 0-frec) and then performing the concep¬ 
tual experiment Sy leading ultimately to a point X in iV. 

Why the insistence on Y being an ancillary statistic? The sample X that wo 
arrive at through the experiment g (or the equivalent two-stage breakdown } — S y ), 
is the only source of our information about 0. Now, according to Fisher, the likelihood 
function 7,(0) for the sample A' is the sole basis for making any judgement about 0. 



RECOVERY OF ANCILLARY INFORMATION 


15 


Nothing else need he taken cognizance of. Let us observe that the likelihood function 
UO) is the same (excepting for a 0-free multiplicative constant) whethe r we cons.de. 
X to be generated by the exi»erimont £ or the conceptual experiment t Y . I his, 
according to the author, is the main explanation as to why in the above > •decomposi¬ 
tion of the probability structure yf. V) into the family \£C„. y? v , *>„) the statistic 
1' has to have a fl-freo distribution. If )’ lx- ancillary then the choice of the reference 
set (^? r , yty, Py) docs not affect the likelihood scale. 


3. A LOGICAL DIFFICULTY 

The decomposition of the probability structure («£?, yi, V) into the family of 
probability structures [*P ¥ . jt 9 , P 9 ) depends on the ancillary statistic* Which 
ancillary statistic Y to work with ? The author made a rather comprehensive study 
(Basil. 1030) of the family of ancillary statistics. It was noted that each of the 
two statistics and may individually be ancillary but jointly not so. Thus, 
in case of a controversy as to which one of the two ancillaries and )'. 2 should deter¬ 
mine the ’reference set’ one cannot solve the dilemma by referring to the conditional 
probability structure conditioned by the observed values of both )', and )'*. Consider 
the following example : 


/Crumple: Let (X, )’) have a bivariate normal distribution with zero 
means, unit standard deviations, and unknown correlation cocHicient 0. 11' (-Y <% )’,), 

i= 1,2. ii, be n pairs of independent observations on (X, }') then wo see at 

once that the set of it observations (X t , X 2 ,.... X n ) on X is an ancillary statistic. 

Similarly ()',, Y. t .)'„) also is ancillary. But the two ancillary statistics together 

is the whole data and is obviously sufficient. In regression studies the statistician often 
ignores the sampling variations in the observed X-values and treats thorn as pre¬ 
selected experimental constants. If, in the above situation, he bo justified in simi¬ 
larly treating the observed T-valuc* also, then how do we define the sampling error 
for the estimate of 0 ? 


Fisher recommended the choice of the ‘reference sot’ with the help of an ancil¬ 
lary Y that complements the maximum likelihood estimator T in tho sense that T 
is not sufficient but the pair ( T , )') is. This, however, is not a sufficient specification 
for Y. The two statistics 1', and Y 3 may each be ancillary complements to the maxi¬ 
mum likelihood estimator T and lead to different ‘reference sets’ and different reli¬ 
ability indices for the estimator T. The following very simple example clearly brings 
out the abovo possibility. 

Example: Suppose wc have a biased die about which wo have enough 
information to assume the following probability distribution : 

«cor©3: 1 2 3 4 6 0 

probability 2 ~~® 3—® 1+0 2+0 3+0 

distributions 12 12 12 12 12 ~12— 


where the parameter 0 can take any value in tho closed interval [0, 1]. Let £ stand 
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for the experiment of rolling the die only once leading to the observed score A'. It 
is easily seen that the maximum likelihood estimator T is defined as follows : 


A' : 

1 

o 

3 

4 

5 6 

T (A'> 

0 

0 

0 

* 

1 1 


and leads to the partition (1. 2. 3). (4. 5. ti) of the 
sufficient statistic and T is not sufficient. 
equivalent 1 ancillary complements to T. They 

sample space. Here A is the minimal 
In this example there are six non- 
may be listed as follows : 

A' 

1 

2 3 

4 

5 

0 

YiiX) 

0 

1 2 

0 

1 

2 

y 7 (Xi 

u 

1 2 

0 

2 

1 

Y,iX) 

0 

1 2 

1 

0 

o 

Yi(X) 

0 

1 2 

2 

0 

1 

Yi(X) 

0 

1 2 

1 

2 

0 

Y,AX) 

0 

1 2 

2 

1 

0 


ISach of the six statistics I'.,. }' 6 is a maximal* ancillary. 


The statistic T induces the partition (1.2. 3) and (4. 5, 6) whereas )', induces 
the partition ( 1 . 4). ( 2 . 3) and (3, 6). Since each repartition intersects each '/'-partition 
in a one-point set. it follows that the pair (7*. >',) is equivalent to A' which is the minimal 
sufficient statistic. Thus. is an ancillary complement to T. In like manner, wo 
prove that each of the other Y ( ‘» is an ancillary complement to T. The joint probabi¬ 
lity distribution for T and is described in the following table : 


Y, 

T v 

0 

1 

2 

total 

0 

1-0 

12 

2-0 

12 

3-0 

12 

2-0 

4 

1 

1 + 0 
12 

2 + 0 

12 

3 + 0 

12 

2 + 0 

■» 

total 

1 

6 ~ 

3 

1 

J 

1 


The ^-decomposition of the experiment of rolling the biased die once is as follows : 

"Choose one of the throe pairs (I, 4), (2. 5) and (3, 6) with probabilities 1/H, 
1/3, and 1/2 respectively. Then select one from the chosen pair with probabilities 


1 — o 

and 

i+/y 

2 * 

if the chosen set is (1, 4). 

• 

1 — 0 

and 

2 + 0 

if the chosen set is (2. 3) 

4 


4 ’ 


3 -0 

4\ 

and 

3+0 

if the chosen set is (3,6).” 


6 6 


• Two statistics nro said to bo oquivnlont if they load to tho said© partition of tho sample space. 
■Sco Basu (1059) for tho definition of » maximal ancillary. 
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The physical experiment of rolling the biased die once may then be imagined 
to be equivalent to the two-stage (conceptual) experiment of first choosing (in a 0 - free 
manner) one of three biased coins and then tossing the selected coin once. 

Let us observe that we have six different decompositions of <5 corresponding 
to the six different ancillary complements to T. How do we recover the information 
lost in T ? 

Let us suppose that the observed value of A' is 5. The corresponding values 
of T, Tj. 1 ' 2 and }* 3 are respectively 1.1.2 and 0 . The conditional distributions of the 
maximum likelihood estimator T under the three conditions = 0 , J ' 2 = 2, and 
}’ 3 = 0 are as follows : 


rango of T : 


0 

1 

conditional probability distribution 
of T under tho condition 

Yi - 1 

(2-0) 

4 

(2+*) 

4 


r,-2 

(3-6) 

"T 

(2 + 0) 
6 


Y> -0 | 

(•-•) 

3 

(2+#) 


Thus, in this situation we find that different choices of ancillary statistics lead to 
different ‘reference sets* and different reliability indices for the estimator T. There 
exists no unique way of recovering the ancillary information. 


4. Conceptual statistical experiments 


The author believes that the real trouble lies in our failure to recognize the 
difference between a real (performable) and a conceptual (non-pcrformable) statistical 
experiment . 1 Every real experiment gives rise to a probability structure (if. yi, JO) 
but the converse is not true. On page U wc saw how the ’ probability structure 
(iC, yt. Jt>). generated by the experiment d. may be decomposed into the family 
1 *v>' !' e '!/■ of probability structures and there we conceived of an experiment 
<S„ corresponding to (iQ,. yl,- P.) In goneral. the experiments 6, are mm-perform- 
able. If (ns in page 10) the statistician selects (on the flip of a coin) between a sample 
of size 10 and one of size 100 , ho is making a random choice between two performable 
■statistical experiments. But in the example considered on page IS the statistician 
can only conceive (in six different ways) of a breakdown of the experiment of once 
rollmg the biased die into a two-stage experiment of first making a ( 0 -free) random 
selection between three biased coins and thon tossing the selected coin once In 
this example the statistician has a die to experiment with; but where are the coins ? 1 


•Tho author does not think it noceasarT to enter into a lengthy discussion 
(nubility of a statistical experiment. 


on the reality or porfor- 


-Of course, the experiment of rolling the die repeatedly until, say. either 2 or 5 
observing only the final score) is essentially equivalent to tossing one© a biased 
bilitios (2 —0)/4 and (2+0)/4. But who is interested in such a wasteful experiment T 
classify such ©xporimenta under the conceptual (non-porformable) category. 


appears (and then 
coin with proba- 
The author would 


3 
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When the sample size n is determined in a 0 -free manner the statistician may 
he justified in regarding n as a pre-fixed experimental constant and in contemplating 
the long term performance characteristic of the experimental procedure 1 with the 
sample size fixed at the level actually obtained. More generally, when the statistician 
is presented with a 0-free choice between a family of performable experimental 
procedures then it would be correct to treat, the }’ actually obtained as a pro-determined 
experimental constant. His sole concern should be the experiment & Y ho is actually 
presented with and none of the other members of the family Difficulty arises 

in the attempted generalization to non-pcrformable meaningless experiments. The 
kind of situations where an experiment £ may bo decomposed into a family 
of real experiments arc very rare indeed. The author is not awaro of any example 
where such a decomposition (into real experiments) may bo effected in more than 
one way. The elementary example considered on page 15 establishes the possi¬ 
bility of a multiplicity of ancillary decompositions into conceptual experiments. The 
ancillary argument of Fisher cannot be extended to such eases. The sample size 
analogy for the ancillary statistic appears to be a false one. We ond this discourse 
with a very elementary example where there exists an essentially unique maximal* 
ancillary decomposition of the experiment but yet the ancillary argument leads us to 
a rather curious and totally unacceptable ‘reference set*. 


Example ; Let X be an observable random variable wit h uniform probability 
distribution over the interval [0. D -f I) where 0 < 0 < co. For the sake of simplicity 
wo consider the case of a single observation on A'. The sample space is the half 
line (0, oo). The likelihood function, for the observation X, is 


L(0) = 



if X-l < 0 < X 

otherwise 


Thus, the integer part [X] of A’ has as good a claim to be considered a maximum likeli¬ 
hood estimator for 0 as any other point in the interval (X — I. XJ. It is easy to check 
that [XJ is not a sufficient statistic. Do there exist an ancillary complement to [X]? 


Consider the fractional part f(X) = X—[XJ of X. It is not difficult to show 
that f{X) is an ancillary statistic with uniform probability distribution over the unit 
interval [0, I). Indeed, it is possible to show that ?(X) is an essentially maximal 
ancillary in the sense that every ancillary statistic is essentially a function of f(X). 
As X =* [XJ+f(X), it follows at once that the pair (|XJ. ?(X)) is equivalent to X and 
hence f(X) is the ancillary complement to [XJ. 


For a given 0 = [0]+f(0), the observation X = lA'J f-f(X) lies in the interval 
\ 0 , 0 +\), i.e., with probability one. 


0 = \0)+f{0) < [X|-| f(X) < l0+lj + f(") = 0+1. 

• Throughout this paper wo are regarding tho inference procedure us a well-defined part of the 
.•\porimontHl procedure. 

a'Tluit is. a decomposition with respect to u maximal ancillary aa defined in Bosu (1959). 
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From the above, it follows that 

f("J if «X)>t(0) 

[X] = i ••• 

l [0+11 if f{X) < 1(0) 

Since i(X) has a uniform distribution over (0, I). it follows that the marginal distribut ion 
of [X] is concentrated at the two points 1 0) and \0 f I) - \0)+\ with probabilities 
1 — 1 ( 0 ) and 1 ( 0 ) respectively. Hence 

£<[X]|0) = KV](l-*("))+(l'']+•)*('') 

= m+m 
= 0 

i.e. [AT] is an unbiased estimator of 0. And 

V([X)\0) = f(0) (l-t(0)l 

Now, since l(X) is the ancillary complement to (X). let us see what •reference set' 
it leads us to. Given f(X), the sample X = (XJ-f-f(X) can vary over the restricted set 

1(X), l+f(X).2-ff(X). 

From the relation (4.1) it is now clear that, for any lixed O. the conditional distribution 
of X = (X]-f-f(X), given f(X). is degenerate at the point 

f»)+f(X). if i(0) < f (X). 

°r. ^ the point l0+l]+f(X). if i(0) > i(X). 

Thus, the reference set’, corresponding to an observed value of the ancillary 
statistic f(X). is a one-point, degenerate probability structure. The conditional distri¬ 
bution of the maximum likelihood estimator (X). given f(X) and 0. is degenerate at 
the point r 0) or (0+ 1] depending on whether i(0i < f(X) or 1(0) > f(X). Acceptance 
of this reference set’ will alter the status of [XJ from a statistical variable to an 
unknown constant. 

Writing } = f(X), the two-stage I*-decomposition of the experiment <S 
of making a single observation on X will then be as follows : 

(i) Solect a number I’ at random (with uniform probability distribution) 
in the unit interval [0, 1) 

(ii) Determine the value of [0] and whether 

(a) 1 ( 0 ) < F or 

(b) 1(0) > Y 
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and then write 

The second stage of the 


^ f l#] + y in case of (a) 

L [0]+ 1 + Y in case of (b). 
y-decomposition is clearly non-performable. 


Refubhoks 

Hasc. I). (1958) : On sampling with and without replacements. Sankhya. 20. 287. 

-(1959): The family of ancillary statistics. Sankhya, 21. 247. 

Cox. D. K. (1958) : Some problems connected with statistical inference. Ann. Math. Slat.. 29, 357. 
KisnKR. K. A. (1925) : Theory of statistical estimation. Proc. Camb. Phil. Soc., 22. 700. 

- (1934) : Two new properties of mathematical likelihood. Proc. Royal Soc., 144A, 285. 

- (1935) : Tho logic of inductive inforonco. J. Roy. Slat. Soc., 98. 39. 

' (1930): Uncertain inforonco. Proc. American Academy oj ArU and Sciences. 71. 245. 

- (1950): Statistical Methods and Scientific Inference. Olivor and Boyd. London. 

OWKN, A. R. O. (1948) : Ancillary statistics and Aducial distribution. Sankhya. 9. 1. 

Hao, C. R. (1952) : Minimum variance estimation in distributions admitting ancillary statistics. Sankhya, 
12. 53. 




COMBINATORIAL PROPERTIES OF PARTIALLY BALANCED 
DESIGNS AND ASSOCIATION SCHEMES* 

By R. C. BOSE 
University of North Carolina 


1. Definition of association schemes and partially balanced 

INCOMPLETE BLOCK (PHIH) DESIGNS 


Partially balanced designs were first introduced in 1039 by the author in colla¬ 
boration with Nair (1039) as an extension of the balanced incomplete block (BIB) 
(Yates, 1936b; Fisher and Yates. 1938; Bose. 1939) and lattice (Yates. 1936a) designs. 
During the twenty-four years which have elapsed since then, much theoretical work 
has been done on the subject and the designs have also been applied to various practical 
problems. Ah the initial work was done by both the authors when they were member* 
of the Indian Statistical Institute founded by Professor P. 0. Mahalanobis. it seems 
particularly appropriate to discuss these designs in this volume. The definition 
of PBIB designs was slightly generalized by Nair and Rno (1942), so as to 
include as spec.al cases the cubic and other higher dimensional lattices. A further 
step was taken by Bose and Shi ma mo to (1952) in introducing the concept of associa¬ 
tion schemes, and basing the definition PBIB design on these schemes. Since most of 
the recent work has been on the combinatorial properties of association schemes and 
PBIB designs based on them, we shall confine ourselves to this topic and leave out the 
analysis of the designs and methods of constructing them. 


Given t, treatments, 1, 2,.... „ a relation satisfying the following 
said to bo an association scheme with m classes : 


conditions is 


(a) Any two treatments are cither 1st. 2nd for n, „ 
relation of association being symmetrical, i.e., if the treatment a is the •.*» ,a 
of the treatment /?, then fi is the i-th associate of the treatment a. * * ^° CUX{Q 


of a. 


(b) Each treatment has n,. i-th assoc,ate the number ,, being independent 


the pair of i-th associates a and fi. * d md< 'P™ d <”>t of 


The numbers 

p » <‘-i. * = 1. 2 ,.... m), 
are the parameters of the association scheme. 


( 1 - 1 ) 


•This research was supported in part by the Mathrm»..v- ^------- 

Office of Scientific Research, under Grant No. AF-AFOSR-84-M ,on of Uk-U nited Air Force 
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If we have an association scheme with tn classes, then we get a PBIB design 
with r replications and 6 blocks based on the association scheme, if we can arrange 
the v treatments into b blocks such that 

(i) each block contains k treatments (all different), 

(ii) each treatment is contained in r blocks, 

(iii) if two treatments a and p are i-th associates, then they occur together 
in \ blocks, the number being independent of the particular pair of i-th associates 
cc and p (i = 1 , 2, m). 

For a PBIB design based on any association scheme, the parameters of the 
scheme may be called parameters of the first kind, and the additional parameters 

b,r,k,A i (t =* 1,2. m), ... (1.2) 

may be called parameters of the second kind. Clearly 

vr =* bk, WiAj-j HjAj + ...-| = r(k —1). ... (1.3) 

2. Relations among the parameters of association schemes 

By definit ion the number p\ k is independent of which pair a, p of i-th associates 
we start with. Consider the pair p, a; we see at onco that 

pU - ri»- - < 21 > 

The following further relations are easy to prove : 

2 », = f-1; ... (2.2) 

w 

L p* fk = rtj if i =£j ... (2.3) 

*-i 

= n i-i if »—i; 

pj* = ”jp{ k = n * Po- ••• < 2 - 4) 

These relations were proved by Bose and Nair (1939). in their paper introducing 
the PBIB designs. These are all the relations in case tn = 2 but for tn > 3 further 
relations were discovered by Bose and Mesner (1959), and will be discussed in a subse¬ 
quent section. 

It is useful to make a convention that each treatment is its own zero-th associ¬ 
ate and of no other treatments. Then clearly we must take. 


n 0 = l; 



... (2.5) 

Pfi = p if = 0 

if 

* 


= n i 

if 

* =i; 

... (2.6) 

p\o = p'ok = 0 

if 

i*k. 


= 1 

if 

i = k. 

... (2.7) 
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We can now write (2.2) and (2.3) as 

Z Hi = v 

i-0 
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Z pj,= 

*-0 


( 2 . 0 ) 


for j, k = 0, 1, ... w. It should also be noted that (2.4) remains valid if one or more 
of i, k, j is zero. 

Also for a PBIB design based on the association scheme we must have 


■» 

Z 

1-0 


Ml r= rk. 


where A 0 = r. 


( 2 . 10 ) 


3. A LESS DEMANDING DEFINITION OF TWO CLASS ASSOCIATION SCHEMES 

The definition given in Section 1, for association schemes is not minimal, i.o. 
the constancy of some of the parameters can be deduced from the others. For two class 
association schemes Bose and Clatworthy (1056) proved the following lemmas : 

Lemma 1 : Let (here exist a relationship of association among v treatments 
satisfying the conditions : (a) Any two treatments are either first associates or second asso¬ 
ciates, (b) each treatment has n x first associates and n t second associates, (o) for any pair 
of treatments which are first associates the number />}, of treatments common to the first 
associates of the first, and the first associates of the second is independent of the pair of 
treatments with i vhich we start. 


Then, for every pair of first associates among the v treatments, the numbers 
Pn and Hi ar < constants and pj, =. p},. 

Lemma 2 : Let there exist a relationship of association among v treatments 
satisfying conditions (a) and (b) of Lemma 1, and the condition (c) for any pair of treat - 
men s which are second associates, the number p ?1 of treatments which are common to the 

^of'treatments WUOcia,a °f '*« •* independent of the pair 

oj It eat merits with which wt start. 1 

. .. Th '!‘' {" tVtTy pa ‘ > 0/ SKOnd •“"Xiates among the v treatments, the numbers 

P 12 . P 21 a,, d p\t arc constants and p\ t = p- r 

answer Uno ° n ° r ** th “ The 

answor is no. Consider the association scheme with * « 7 for which H,a fi rc » ,1 

second associates are shown below • ’ ® rst an< * 


troAtment 

first associates 

second associate* 

1 

2 

2. 4. 6. 7 

3. 6, 6 I 

3. 6 

4. 7 

3 

4 

6 

4. 6. 7. 2 

6. 7, I. 3 

6. I. 2. 4 

5. I 

6. 2 

7 3 

6 

7. 2. 3. 5 

I. 4 

7 

1. 3. 4, 6 

2.5 
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Here «, = 4, n t = 2. For any pair of treatments a, /? which are second 
associates />;, is 3 independently of a, p. Hence Lemma 2 is satisfied with p\ 2 = Pi\ 
= 1, = 0. However, for any two treatments a and /? which are first associates 

/>}, is either 1 or 2. 

In view of the Lemmas 1 and 2, the condition (c) in the definition of m class 
association schemes given in Section 1, may be replaced in the special case m = 2, by 
the condition (c'), for any pair of treatments which are i-th associates the number/?{, for 
i=l, 2, of the treatments which are common to the first associates of first and first 
associates of the second is independent of the pair of treatments with which we start. 

For a two class association scheme, the values of the parameters p} 4 . ( i,j, k 
= 1,2), may conveniently be written in the form of two symmetric matrices 

Px = <p}.> - ( p!l P]t V = (Pj.) = ( P '' PU V - ( 81 ) 

\ Vti Pti J \ p \i pU / 


4. Some examples ok two class association schemes and pbib 

DESIGNS BASED ON THEM 

Wo shall give below some simple examples of two class association schemes, 
and a few designs based on them. This enumeration is for illustrative purposes and is 
not exhaustive. 


(a) The yroup divisible ( OD) association scheme. In this case there are mn 
treatments, which are divided into m groups of n treatments each. Two treatments 
belonging to the same group are first associates, and two treatments belonging to 
different groups arc second associates. The association scheme can be exhibited by 
writing down the mn treatments in the form of a rectangular array, the treatments 
of the same group occupying the same column. It is readily seen that the parameters 
of the association scheme so obtained arc 


v = mn, Wj = n— 1 , n t = n(m— 1), 

/ n-2 0 P,-( ° "- 1 \ 

\ 0 >i(m — 1) / * * \n— I w(m—2) / 


(4.1) 

(4.2) 


For example let m - 4. n - 3. The corresponding GD association scheme is 


12 3 4 

5 6 7 8 

9 10 11 12. 


(4.3) 


The firet associates of the treatment 1 are 5 and 9, and the second associates 

are 2, 3, 4, 6, 7, 8, 10, II, 12. 

A PBIB design based on the above association scheme for which the para¬ 
meters of the second kind arc 

6 = 9, r = 3, i = 4. A,-I. A, = 0, ... (4-4) 
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is given below : 


(1, 

8 , 

2 , 

3), 

(8, 

5, 

0 , 

7), 

(5, 

2 . 11, 

4), 


(6, 

11 , 

12 , 

1 ). 

(11. 

10 . 

9, 

8 ), 

(io. 

12. 3, 

• r >). 

.. (4.5) 

(12, 

9. 

7. 

2 ), 

(7, 

4, 

1 , 

10 ). 

(0. 

3, 4. 

«). 



(b) The triangular association scheme. Wc take an m x m squaw, ami fill-in 
the positions above the leading diagonal by different treatments, taken 

in any order. The positions in the leading diagonal are left blank, while |K>sitions below 
this diagonal are filled so that the scheme is symmetrical with res|>cet to the diagonal. 
Two treatments in the same row (or same column) are first associates. Two treatments 
which do not occur in the same row or same column are second associates. It is 
readily verified that the parameters of the association scheme so obtained are 


v = m(m- 1 )/2, w x = 2m -4, n t = (m- 2)( m- 3)/2, 

2m-8 
(m-4)(m 

This scheme is called the triangular association scheme. 


w - 3 V />, / * 2m—8 \ 

\m-3 (m-3Km—1)/2 / ' \ 2m—K (m 4)(w-5)/2/ 


(4.«) 

(4.7) 


An interesting class of PBIB designs based on the triangular association scheme 
“ formed by taking for block-, treatment- in tl,o same row of the UH-ociation scheme. 
For these designs wo will have 


b-m, r= 2 . i - »-l, A, = 1, A, - 0. 

As an illustration lot take = 5. Tho a-ociation achemc i- (hen 


•12 3 4 

1*507 

2 5 • $ 9 

3 G 8 • 10 

4 7 9 10 • 


.. (4.8) 


whore two different treatments are first associates if they 
row (or same column) of the above scheme, and second 
parameters of the association scheme are 


occur together in the 
associates otherwise. 


same 

The 


v = 10, 


6 , w a = 3. 


:)• -c :)• 


By taking tho row- of (4.8) for blocks wo get the design with 
second kind 


... (4.9) 

... (4.10) 

parameters of the 


4 


6 = 5, r=2, 6 = 4, A, = 1 , A. = 0. 


... (4.11) 
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There may be more than one PBIB designs based on the same association scheme. 
For example there exist at least three other designs, besides (4.11), based on the trian¬ 
gular association scheme (4.8). We give below the parameters of the second kind, 
(4.12), (4.14) and (4.16) together with the corresponding blocks (4.13), (4.15), (4.17) 
for these designs : 

6 = 10, r = 3. k = 3, Aj =1, A. = 0. ... (4.12) 

(1, 2, 5), (8, 9, 10), (2, 8, 3), (7, 5, 9), (9, 4. 2), 

... (4.13) 

(5, 6, 8), (3, 10. 4), (10. 7, 6), (4, 1, 7), (6, 3, 2). 

6 = 6 , r = 3, k = 5, A l — 1 , A* = 2. ... (4.14) 

(1, 8. 9, 7, 3), (1, 8, 4, 10, 5), (8, 4, 6, 7, 2), 

... (4.15) 

(4, 6. 9, 5, 3), (1, 6, 9, 10. 2). (10, 7, 5, 2, 3). 

6=10, r = 4, k = 4, A, = 1, A* = 2. ... (4.10) 

(2, 10, 6, 7). (10, 1, 2. 5). (7, 3. 8. 2). (6, 2, 9. 4), (1, 9, 10, 8), 

(5, 4, 3, 10), (8. 7. 4. 1), (3, 5. 7, 9), (9. 6, 1, 3), (4, 8, 5, 6). 

... (4.17) 


(c) The singly linked block ( SLB) association scheme. Consider a balanced 
incomplete block (BIB) design D with 6 treatments, v blocks, k replications, block size 
r and A = 1, i.c. every pair of treatments occurs in exactly one block. Then 

bk = vr, 6-1 = k{r — 1). ... (4.18) 

Consider v new treatments each corresponding to one bloek of D. Two of these 
now treatments will be called first associates if the corresponding blocks of D have 
a common treatment and second associates if the corresponding blocks of D have no 
common treatment. Shrikhande (1950) has shown that this association relation satis¬ 
fies the conditions (a), (b), (c) of Section 1 with parameters, 


v = k(kr—k+l)/r, n 

T 


r(k- 1), n a = (*-r)(r-l)(*-l)/r. 


/ (*- 2 )+<r— l)* (r-l)(*-r) \ 

1 * \ (r— 1 )(k — r) (r— 1 )(k — r)(k —r 1 )/r / 




r(*-r-l) 


r-1) 

(*-r)(r-lK*-l) 


— r[k— r— 1)— 1 


... (4.19) 
... (4.20) 

... (4.21) 


This association scheme is defined to be an SLB scheme. Every BIB design 
with A = 1 gives rise to such a scheme. 

Let D • bo the dual of the design D. i.e. the blocks and treatments of D- corres¬ 
pond to the treatments and block- of D, and a block of O* contains a treatment of D 
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if and only if the corresponding treatment of D, occurs in the corresponding block of 
D. Then D * is a PBIB design based on the association scheme just described, 
for which the parameters of the second kind are 

b, r, k, A, = 1, A, = 0. ... (4.22) 

These designs are known ns singly linked block designs. 

In the special case r = 2, when the BIB design D consists of all possible pairs 
of r treatments, the SLB scheme reduces to a triangular scheme with m = Jb+I. 

(d) The Latin square (L r ) association scheme. Consider v = k 2 treatments 
which may be set forth in a kxk scheme. Thus if k = 4 and the treatments are 
1, 2, .... 16 , we have the scheme 


1 

2 

3 

4 

!~ 

6 

7 

8 

9 

10 

11 

12 

13 1 

14 

15 

16 j 


... (4.23) 


For the case r =- 2, wo define two treatments ns first associates if they occur 
m the same row or column of the square scheme, and second associates otherwise. 
The association scheme so defined may be called the L, association scheme. The 
parameters of the L, scheme arc 

*-**• "i-=2(*-l), -<*-!)*, ... (4 . 24) 


P,. ( k - 2 P / 2 2(*-2)\ 

\A-1 (*—!)(*—2)/ * \ 2(lc —2) (*-2)*/ 


(4.23) 


In the general case 2 < r < k+ 1, we take a set of r-2 mutually orthogonal 

LoTr2T S , 7 7 et eXiStS) - , F ° r a " L ' ““**«<>" -"en,a wo then define 
two treatments to be first assoc,ates if they occur together in the same row or column 

the square scheme, or ,f they correspond to the same symbol of one of the Latin 

squares. Otherw.se we define then, to be second associates. For example if * = 4 

r — 4 and wo take tho Latin squares 


[L,] 


1 

2 

3 

4 

2 

1 

4 

3 

3 

4 

1 

2 

4 

3 

2 

1 


[I*] 


1 

2 

3 

j 

4 

J 

3 

4 

1 

2 

4 

3 

2 

1 

2 

1 

4 

3 


(4.20) 
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then the first, associates of the treatment 7 are 5, 6, 8, 3, 11, 15, 4, 10, 13, 1, 
12 . 14 because the treatment 7 corresponds to the symbol 4 in [L,] and the symbol 
l in fL 2 ]. The parameters of the L r association scheme are given by 


= **, = r{k — 1 ), w 2 = (*-l)(fc-r+1), 

... (4.27) 

' (*-2)+(r- lXr-2) (r- l)(fc-r+1) \ 

... (4.28) 

,(r-l)(*-r+l) (fc-rX*-r+l)/ ’ 


p.-f*- 1 , **- r) V 

... (4.29) 

\r(k-r) (k —r)*+(r— 2) / 



The simplest class of PBIB designs based on the L, schemes are the lattice 
designs, first introduced bv Yates (1936a), which are obtained as follows : 

We obtain k blocks each of size k by putting in the same block all treatments 
occurring in the same row of the square scheme. This gives us one complete replica¬ 
tion. Another complete replication is obtained in the same way from columns. Again 
from each of the r —2 mutually orthogonal Latin squares we obtain k blocks giving a 
complete replication by putting all those treatments which correspond to the samo 
symbol, in the same block. The parameters of the second kind for the Lattice design 
so obtained are 


b = kr, r, k, *=» 1. A 2 =* 0. 


(4.30) 


For example for the case k — 4, r — 4, the lattice design based on the squaro 
scheme (4.23) and the Latin squares (L,) and [L t ] in (4.26), is 


lie]) 1, 

(1. 

2 . 

3. 

4). 

Rep 2. 

(1. 

5, 

9, 

13). 

Rep 3, 

(1. 

6 , 

11 . 

16), 

R< p 4, 

(1. 

^ » 

12 . 

14). 


(5. 

6 . 

7, 

8 ). 

(9. 

10 , 

(2. 

6 . 

10 , 

14). 

(3, 

7. 

(2. 

5, 

12 , 

15). 

(3. 

8 , 

(2. 

8 . 

11 . 

13). 

(3. 

5. 


11, 12), (13, 14, 15, 16), 

11, 15), (4, 8, 12, 16), 

9, 14), (4, 7, 10, 13), 

10, 16), (4, 6, 9, 15). 

... (4.31) 


If wo had chosen only the Latin square [L,], the design obtained would 
havo been given by the first 3 row. of (4.31). Letcall this design D,. To illustrate 
the fact t hat there .nay be design, other than lattices based on an L, association scheme, 
wo give below another design based on tl.o same L, scheme as D,. 1 he parameters 

of the second kind for this design are 


16 , 


3, k = 3, A, = 0, A 2 = 1, 


(4.32) 


and the blocks arc 


(10, 

7. 

16), 

(11, 

8 , 

13), 

(13, 

4. 

6 ). 

(14. 

1 . 

7). 

(7. 

9, 

4). 

(8. 

10 , 

1 ). 

<2, 

16, 

9). 

(3, 

13, 

10 ). 


(12, 5, 14), 

(15, 2, 8), 

(5, 11, 2), 

(4, 14, 11), 


(9, 6, 15), 

(16, 3, 5), 

(6, 12, 3), 

( 1 » 16 . 12 ). 


... (4.33) 
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(o) The cyclic association scheme. Eel the » treatments he the » 
integers denoted by 1, 2, .... v. Let 

<*i.«*».<*-, ... (4.34) 

be a set of n, integers satisfying the conditions 

(i) the d's are all different, and 0 < d t < v (j = 1,2, ..., n t ), 

(ii) among the n,(n, — 1) differences dj—dy, (j,j‘ = I. 2 , .... n t ,j 9 k j ) reduced 

(mod v), each of the numbers d v </,. .... d H ^ occurs g times, whereas each of the numbers 
<i. «*,.... occurs h times, where i x , d v .... t t , e t ,.... e Ug are all the different 
u—1 numbers 1,2. v— 1. 

Clearly it is necessary that 

I)• ••• ( 4 - 3r ») 

Let the first associates of the treatment i be 

*+d t .«+J fl| (mod i>), ... (4.30) 

and the remaining treatments be second associates of i. The associat ion thus defined 

is a two class association scheme with parameters v, a,, n t , 



n t -g-\ 
h*- w i+0+ 1 


n t —h 

w a— n t +h— 1 



For oxamplo taking v » 13, and 


(4.37 


(4.38) 


<*1-2. 6, <*,= 6. d 4 = 7. <1,-8. rf.-ll 

wc find that among the differences d r d; reduced (mod 13) each d occurs twice, 
whereas every other non-zero integer less than 13 occurs thrice. Hence t he conditions 
(l), (n) are satisfied. Wc thus have a cyclic association scheme with parameters 

v = 13, n, = 6 . n t = 6 , ... ( 4 . 39 ) 


P, 




(4.40) 


An example of a PBIB design based on this association scheme, is provided 
by the design with the second kind of parameters 



... (4.41) 
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and the blocks 


(1, 3, 

0 ). 

(3, 

4, 

10 ), 

(3. 

5. 

11 ), 

(4, 6, 

12 ). 

(5, 

7, 

13), 

(0, 8, 

1 ), 

(7, 

o. 

2 ), 

(3. 

10 . 

3), 

(9. 11, 

4). 

(10, 

12 , 

5), 

(N, 13, 

6 ), 

(12. 

1 , 

7). 

(13. 

2 . 

8 ). 




• , 

. (4.42) 


f>. Association matrices and the algebra of association schemes 

Consider an m class association scheme. Tho t-th association matrix is 
defined by 


= M) 


*>\< 


... b\ t 



... *>li 


(5.1) 


where />J,. =a l if the treatments a and ft arc *-th associates 

= 0 otherwise. ... (5.2) 

Hence B { is a symmetric vxv matrix in which the element in tho a-th row 
and ft-th column is unity if the treatments a and ft are »-th associates and 0 otherwise. 
The total of each row and each column in B { is n 4 . Clearly 

B 0 = /„ the vxv identity matrix. ... (5.3) 


It is also readily seen that 

B 0 +B v ..+B m - .7. 


(5.4) 


where J„ is the vxv matrix each of whoso olements is unity. It is also clear that tho 
linear form 

c„B 9 +e l B l +- +c m B m - (»•») 

is equal to the zero matrix if and only if 

c 0 = c i = c m — °- 


Hence linear functions of B 0 , B x . B m form a vector space with basis B 0 , B x . B m . 

Thompson (1954, 1958) and independently Meaner (1956) proved tho 
fundamental formula 

B f B k = p% Bo+pfr B x -\ - i-Pjl B m . ... (5.6) 


This shows that the product of any two matrices of tho form (5.5), may be ex¬ 
pressed as a linear combination of terms of the form B i B k and will reduce to tho form 
(5.5). The set of matrices of this form is closed under multiplication. Wo will here 
confine ourselves to the case when the coefficients c, range over the field of real numbers. 
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The linear functions of the association matrices B 0 , 1 .... B m form a linoar associa 
tive algebra. Using the fact 

B&Bfr) = (B t B t )B k , 

one can show that (Bose and Meaner, 1959), 

2 P"i pit = X p u k p‘ iu . ••• (*- 7 

u «* 


where u runs from 0 to in and the remaining indices arc arbitrary but fixed and 

0 < i,j, k, l < in. 

Now let us define II* by 


n* — (fib) — f p« 


Pot 

Pot 

• • • 

Pot 

p°i* 

Pit 

... 

pTt 

pit 

pit 

... 

Pit 


0, 1, Ml. 


(3.8) 


'1‘hen (5.7) is equivalent to 

n i n * -■ pi n o+pin l +— 


(3.9) 


Thus the matrices II 4 givon by (5.7) multiply in the same manner us the association 
matrices B k (k ^ 0, 1,.... m). From (2.7) it follows that if 


c 0 n 0 +c 1 n 1 +-+c - ,n w = o. 

thon c 0 = c, — •••= c m a 0 , 

i.o. n 0 , n,.n„ are linearly independent. They thus form the basis for a vector 

space and combine in the same way as the B 's under addition us well us multiplication. 
They provide a regular representation in (»i + l)x(m + l) matrices of the algebra given 
by the B' s, which aro vxv matrices. In particular 


n o = /.+i. ... (5.10) 

This regular representation was discovered independently by Bose (1955) 
and by Mcsnor (1956), and further properties wore studied in a joint paper (1950) by 
both. Some of these will be mentioned later. 


Since the B's are commutative, tho IT* aro commutative. In general they 
are not incidence matrices and are not symmetric. In analogy with (5.4), all tho ele¬ 
ments of the row j of E II* are equal to n,. Let 


B = c 0 B 0 +c l B l +...+ Cm B m , ... (6 . n) 

bo any dement of our algebra, and let/(A) be a polynomial. Then ,v„ can express 

AB) = l t B„+l,B I + —+l m B m . ... (5 12 j 

II = <*n,+e 1 n l +... +( -..n,, ... (5 , 13) 


If 
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is the representation of B, then 

W) = /on 0 +/in 1 +.-4-/„n m . ... (5.i4) 

Let /(A) be the minimum function of B, i.c. /(A) is the monic polynomial of 
least degree for which 


f(B) = 0. 

Similarly let 0(A) be the minimum function of II. 

Then f(B) = 0 ->/ 0 = /, = ... = l m = <>-►/(II) = 0 


i.o. /(A) is divisible by 0(A). In the same way 0(A) is divisible by /(A). Since both 
are monic polynomials 


/(A) - 0(A). 

Hence B and II have the same distinct characteristic roots, and every matrix B, has utmost 
m+ 1 distinct roots, which are solutions of the minimum equation of II. In general 
the number of treatments is much larger than the number of classes m, so that the roots 
of B have high multiplicities. 

Since B t B k = B l B J it follows that 

n, n* - n* n,. ... (5.15) 

It is easy to show that the relations (2.4), (2.8), (2.9) among the parameters 
of the association scheme are consequences of (5.15). However, this relation leads to 
new identities when m > 2. For examplo in the case m = 3, Bose and Meaner (1969) 
show that there is a new identity 



a. /iflLSlt.p ^n a a ia +n 1 w,n,) — 0, ... (5.10) 

\ ?ij n t n t 

where « 12 = "iPlz = *»Pf*» a 3i = "aPu = M iPis» a 23 = n *Ph = n *Pz* 

x = n,pj3 = n tPis = W 3Pl2- 

This identity is not derivable from (2.4), (2.8), (2.9). 

Given a set of positive integral parameters t>, n Jt p\ k ( i,j,k = 0 , 1 , .... m), 
satisfying (2.5). (2.0). (2.7), »»« '"*>• ; '» k whether it is possible for an m class associa¬ 
tion scheme with these parameters to exist. Then the matrix equafons (S.lo) 
provide necessary condition for existence. 
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6. Combinatorial applications of tiib alcbiika ok association matrickn 

(a) Consider a PBIB design based on an m class association scheme, with the 
association matrices /?, defined by (5.1). Let 

N = s— 1,2,... v, j = 1,2 .6; ... (0.1) 

be tho incidence matrix of the design, i.e. n i} * I or 0 according as the treatment i 
docs or does not occur in the j'-th block. Then 

B-NA" I =r^ 0 +A 1 B l + ... + ^^. ... (6 . 2 , 

n = rn o +A,n,-t-hA^n,,. ... (6.3) 

The elements of NN' are non-negative and for connected designs, i.e. designs 
in which every treatment contrast is estimable. .VA" is irreducible. Also in virtue 
of the identity ( 2 . 10 ) the sum of the elements in every row of NN' is rk. Hence 


B m 



B 


-71 »»'■ 


(6.4) 


is » stochastic matrix (i.e. an irreducible matrix for which tho sum of each row is unity), 
hor such a matrix (Brauer. I0S2), unity is a simple root and is greater than all the 
other i-oots. Honce rk is a simple root of B and is. therefore, also a simple mot of n. 


Then 


p h ™ r Pio + *ip{i + --- +A* 

n - ( Pll ). 


root of n 

wo have 


? 

1 

Poi 

Po 

, Pio 

Pn —0 ••• 

Pi- 

1 

• • • • • • 

• • • 

1 P-0 

Pm I 

Pmm-0 


*\ T ow from (2.5)—(2.10), 


(6.5) 


Henoo 


Z Pil - r S pJo+A, 1 p/. + .-.+A, ^ pi. 
= n * r + n i^i+. n m A^ = rk. 


(rk- 0 ) 


1 

I 

• • • 

1 

Pi o 

Pu -ff 

• • • 

• • • 

• • • 

Pi- 

! Pm 0 

P -1 

••• 

• • • 

Pmm 


= 0. 


o 
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Therefore the characteristic roots of n other than rk, are roots of the matrix 

II* =(/>«) .m; ... (0.6) 

where = PiS~Pio 

= r5 0 +A x j>Ji+.. + A*p{ m —... (67) 


S,j being the Kronecker delta. 

(b) Fisher (1940) showed that for a balanced incomplete block (BIB) design 
there holds the inequality 

b >V - (6-8) 

where b is the number of blocks and *• is the number of treatments. (For an alternative 
proof sec Bose (!»-*«)). One may ask what the corresponding result is for PBIB 
designs. Now 

6 > rank N 


> rank NN'. 

But the rank of AW' is e. unless NN' is singular, i.o., has a zero characteristic root 
in which case n and therefore IT has a zero characterise root. I hus. 

A necessary condition for b < v in a PBIB design is 


where p* 0 is given by (6.7). 

Thus Fisher s inequality 6 > v is satisHed in genera'. It can U . violated 
|»y only those designs for which (6.9, i- satisfied. Th.s result,» due to Na.r (.943). 
An alternative proof will be found in Bose (1962). 

(0 , The multiplicities of the characteristic roots of B - can be calculated. 

. . „ \. „ , be these characteristic rooks with mult.pl.ct.es a„ - 1. 

I • I Then "o’ o" .are .he characteristic roots of fl. Bemembcr.ng that 

Z t™^f any LtHx’is equal to the sum of its characteristic roots we have 

... ( 6 . 10 ) 


a„ </ S +a, 0J + -+a.<C = »r B", « = 0, 1. 2. 

Using the fundamental formula (5.6). we may express B" in the form 

B m = c 0n B 0 +c ln B l c mn B*. 

Then since is the only « with non-x.ro diagona. elements 

tr B n = i -c 0 n- 


( 6 . 11 ) 


( 6 . 12 ) 
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We shall illustrate the determination of the multiplicities a- by considering 
the case m = 2. In this case 0 X and 0 t arc the roots of the matrix 

r+*iPn+*iP\t -Mi A.pf.-f Ajpfj-WjA, 

A,pl, + A*?** - M* r +A,pfi+A,p| 2 - M* 

Using the identities connecting the parameters we get after some computation the 
result that 0,, 0 t satisfy the quadratic 



) 


... (6.18) 


(r-tf)*+[(A l -A a Krit-l4t)-'(Ai+A a )J(r-0) 

+K^i - A»XAtP!i“A l />| l )+A,A|) ■ 0. ... (6.14) 

Setting y=p!,-p!,. P = l>\,+p]t- A = y« + 2/?+l. ... (6.10) 

we have 0, - r+J{(A 1 -AJ(V'A+y)-(A,+A t >]. ... (6.16) 

0, _ r-«(A 1 -A,KVA-y)+(A 1 +A t )). 

Now from (6.10) tr / - l+a.+a, - t>, ... (6.17) 

tr NN' = rk+a, 0,+aj), = vr, ... (6.18) 

whence after some calculation 


a. - »!+"• -fri -M+rOh+ M 
2 o*/a 


(6.19) 


ai ^P + <n.-n.l+Xn l+ n,) (8 . 20) 

It is interesting to note that the multiplicities a, and a, depend only on the 
parameters of the association scheme, i.e. parameters of the first kind. This is a 
special case of the following result due to Bose and Mosnor (1954) : 

l ! f ~ c o B o+«A+-+^B. is a linear function of the association matrices of 
an association scheme, then 


\B-I0\ = (0 o -0) * (0,-0)“' ... (0 m -d) m , 


... (6.21) 

can be used to prove the impossibility of certain association schemes. *' 
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We are now in a position to see how Fisher s inequality should be modified 
lor the case when II and therefore II* has a zero characteristic root. Let a be the 
multiplicity of the root zero of B = NN'. Then 

b > rank N 
> rank NN' 


Hence Fisher'a inequality is replaced by 

b > o-a. ... (6.22) 

This result is due to Connor and Clatworthv (1954). 

(d) Since the distinct roots 0 o , 0 X , .... 0 m of NN ' are the roots of II, the 
O' s are functions of parameters of the design. Since NN ' is symmetric the O' s are 
all real and positive. This fact yields interesting inequalities among the parameters 
of the design. 

For PBIB designs based on two class association schemes we get the 
inequalities, 

r > IKA.-A.H-vM+yl+fA. + A,)]. - (6-23) 

r > «<A, —A t )(v£-y)+(A,+A,)). ... (6 24) 

(e) Wo shall illustrate some of the abovo results with reference to group 
divisible PBIB designs, based on the group divisible (GD) association sohemo, defined 
earlier. From (4.2) and (6.15) we have 

y = n— 1 , P — n — 1, A — n*. ... (0- 2 ®) 

Hence from (6.16), (6.19). (6.20), using the identities connecting the parameters 

0 X =. r+w(AA t )—A, =- rk — vA t , 0 t = r—A,. ... (6-26) 


a, = m— 1, a, = *>— m. 


(6.27) 


We therefore have the following result: 

Group divisible designs can be. divided into three classes : 

(i) Regular group divisible designs for which rk-v\ 2 > 0, r-A, > 0. For 
these Fisher's inequality b v holds. 

(ii) Semiregular group divisible designs for which r—A x > 0, rk — v\ 2 — 0. 
For these designs b ^ v —w/-M. 

(iii) Singular group divisible designs for which r— A, = 0. For these designs 

b p m. 

F,. on , (6.21) it follows that for a group divisible design 
| A r iV' — /^| = (rA-0)(rA— vA t —0) m ~ l (r—A x — 0) v 


(6.28) 
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Hence for a regular symmetrical GD design 

(det N)* = | AW'| = r*(r*—uA,)" ** (r-A,)" 1 "-'*. ... (0.29) 

It follows that for a regular symmetrical OD design (i) if in is even, then r 2 — vA 2 
is a perfect square ; (ii) if m is odd and n is even, then r A, must he a perfect square. 

The results given above were first obtained by Bose and Connor (1952), by 
ft more direct method. 

We have used the group divisible designs as illustration but it is clear that 
similar results can be proved for PBIB designs based on the other association schemes 
described in Section 4. 

(f) We shall now examine for two class association schemes and PBIB designs, 
the consequences of the integral or non-integral nature of \/A. and the equality or 
inequality of the characteristic roots a, and x 2 of NN' (other than the simple root rk). 
These results are due to Connor and Clatworthy (1054). 

The parameters n x and » s are both integers. If n t is zero any two treatments 
will be first associates, and the corresponding design will become a BIB. We shall 
exclude this trivial case and assume that n, and n. are non-zero positive integers. 
Wc shall set 

9 - (W|-i»,)+y(i» l +* 1 ). ... (0.30) 

(i) If A is not an integral square x t « a,. Conversely if x x « « 2 . A may 
or may not be an integral square. From (2.2), (0.19), (0.20) and (0.30) 


a 


i 


v~l 
2 * 




(0.31) 


If A is not an integral square, we must have 7 * 
Hence a, » a 2 . 


0 , since x x and a 2 must he rational. 


A (WhTT' V if V ?*' lhC " ’ = °- bUt thi “ ,loes not p»‘ »">• "•’friction on 
la this c ase ° XamP ^ * MOcUtion schom - "Ml parameters <4.:t9), (4.40) 


a i =» a 2 r= 0. A = 12. 

have* fOF tHe L * “*°° iRti0n 8Ch0me with P-r*meU>rs (4.24). ,4.25) ,eking t w 


®i * «i ® 4, A = 9. 

(ii) If a 2 (which is necessarily the case when A 

Pit = Ph = t, 

a, = a t = n, = n,=(t>-l)/2 _ o/, 
t» = A = 4/+1. 


is not an integral square) 

... (0.32) 
... (6.33) 
... (6.34) 
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3S 


Since a, = ct», we have 17 = 0 or 

r 

whence y = 0, n 2 = »„ and p } 2 = />?. = / (say). The other results easily follow. 


<i * 


(iii) If v is even, A must be an integral square and 1 / given by (6.30), must be 
a non-zero integer divisible by v A. This follows from (6.31) by noting that rj/V A 
must be an odd integer. 

(iv) If v is odd, then either tf = 0 , a, = a, (in which case (6.32), (6.33), (6.34) 
hold) or rf is a non-zero even integer, and A is an integral square. This follows 
by noting that from (6.31), 7 /2\/A must be integral. 

7. Partial geometries and the corresponding pbib designs 

A partial geometry (r, k, t) is a system of points and lines, and a relation of 
incidence between them satisfying the following axioms: 


Al. Any two distinct points are incident with not more than one line. 

A2. Each point is incident with r lines. 

A3. Each line is incident with k points. 

A 4 . If the point P is not incident with the line l, there are exactly t lines 
(/ > I) which are incident with P. and also incident with some point incident with l. 

Clearly 1 < I < k, 1 < < < r. 

(a) If there were two distinct lines l and m each incident with two distinct 
points P, and P a , then Al would be contradicted. Hence : 

A'l. Any two distinct lines are incident with not moro than one point. 

Given a partial geometry (r. Ic. I), thrre exist, a dual partial gram'try (fc. r, t) 
Obtain'd by calling the point* af the first, thr lines of the second, and tb' lines of the second 
the points of the first. 

The above follows by noting the duality of Al and AT, the duality of A 2 
and A3, and the self-dual nature of A4. 


For convenience we may introduce the ordinary geometric language. Thus 

may be rephrased as: 


A4. 


Through any point Pno, lying on a line /. there pass exactly 1 lines inter- 


secting l- 
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It is easy to show that the number of points v, and the number of lines h in a 
partial geometry (r, k, t ) are given by 

» = *((r-lM*-l)+']/' - (71) 

b = r[(r-l)(k-l )+<]//• ... (7.2) 

(b) Partial geometries are isomorphic with a class of PBIB designs. Points 
of the geometry may be called treatments and lines of the g<*onictrv may be called 
blocks. The relation of incidence now becomes the relation of a treatment being 
contained in a block. Two treatments can be called first associate* if they occur 
together in a block and second associates if thoy do not occur in a block. Using 
the axioms A1 to A4 one can now prove that the association relations thus defined, 
satisfy the conditions (a), (b) of Section I. and the condition (c') of Section 3. The 
parameters of the two class association scheme thus obtained are 

f = *[(r- IX*-!)+*]/<. », - r(*-l), a, = (r— 1 )(4r — 1)(* —/)//, ... (7.3) 

(f-l)(r-l )+*-2 (r— IX*—0 

(r- !)(*-<) (r-IX*-/)(*-/- I)/f 

rt r{k —/— 1 ) 

This association schome may be called the geometric association scheme with 
characteristics (r, *, I). 

Thus a partial geometry is equivalent to a PBIB design with jtarameters of the 
second kind 






», 6, r, *, A, — I, A. * 0. 


(7.6, 


the parameters of the association scheme being given by ( 7 . 3 ), (7. 4 ). ( 7 . 5 ). 

(c) Bose and Clatworthy (1955) considered two class PBIB designs with 
r < k, A. — I, A, = 0. From the results of Section 6, it follows that for such designs 

%»* m i __ i .... ® 


the matrix IT given by (6.13, has a zero characteristic root, if wo take A 
Hence from (6.14) 1 


1, A. = 0. 


rpit-(r-l)p? t = r(r—1). 


(7.7) 


Using this relation, and the identities (1.3), (2.1) (2 2) (2 t? ±\ u j 

ai - - 
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Let K be the set of * treatments contained in a particular block, • and let 
/T be the set of remaining v—lc treatments. Let g(x) denote the number of treatments 
in /T which have exactly x first associates in K. Then 

S g(x) = v-k = k(k-\)(r-l)/t. ... (7.8) 

r —0 

Bv counting the number of pairs {P, Q). where P is a treatment in K, Q is a 
treatment in K, and P and Q are first associates, we see that 

v x , Ax) = * (Wl _*+i) = *<r-!)(*-1). ... (7.9) 

T-0 

Similarly by counting the number of triplets (P,. P 2 . Q) where P,P 2 is an 
ordered pair of distinct treat ments in K. and Q is a t reat ment in K which is a first asso¬ 
ciate of both K x and K 2 , wo get 

S x(x-\)g(x) - k(lc- l)(p|,-*+2) = *(*-l)(<-l)(r-l). ... (7.10) 

x -0 


A simple calculation shows that X, the avorage value of x, is 

x - Zxg(x)lZg(x) = /, 


(7.11) 


and 


var x — E g(x){x —<)* =» 0. 


(7.12) 


Hence * must always have the value /. This is equivalent to the axiom A4. Hence, 
a PBIB design with r replications, block size k t X x = 1, A, * 0, is a partial geometry 

(r, k, 0 if r < k. 

(d) One may ask whether a partial geometry (r, k, t) exists for all values of 
r k t. Now for the corresponding PBIB design the multiplicity a, of the characteri¬ 
se root of the incidence matrix NN' is given by (6.19). Substituting for n„ * 
and A from (6.15). (7.3). (7.4) and (7.5) we have 




rk(r — 1 ){k 1) 

t(k+r-t-\) 


... (7.13) 


Hence a nectary condition for the existence of a partial geometry (r. *. *><» 
tka, the number a, giuen by (7.13, is a positive integer For 

“ 2^ i HZ* <Bose and Clatworthy.’ .«> 

shows the case *= 11 to be impossible. 


(e) 


We shall now consider some examples of partial geometries. 
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(i) Consider the lattice designs described in Section 4(d) based on the Latin 

square scheme L,. The parameters of theso designs are given by (4.27), (4.28), (4.2!)), 
(4.30). If we consider the treatments as points and blocks as lines, then axioms 
Al, A2, A3 are obviously satisfied. Now it follows from the method of derivation 
of the lattice designs from orthogonal Latin squares, that any two blocks of different 
replications have exactly one treatment in common. Suppose there is a treatment 
a and a block B * of the i-th replication not containing a. Then there will bo exactly 
one block in each replication which contains a. Let /?,. B 2 . •••• •••• &r 1,0 

blocks. Then B ( has no treatment in common with B\ whereas the other blocks 
B x , .... 2? I+I , .... B r have each one treatment in common with ZT. This shows 

that axiom A4 is satisfied with t = r- 1. Hence a lattice design with parameters 
(4.27), (4.28), (4.29), (4.30) is a jtartial geometry (r, k, r— 1). The geometric association 
scheme with characteristics (r, k, r— 1 ) is identical with the L, association scheme, it 
is easy to verify that by putting t = r— 1 the formulae (7.3), (7.4), (7.5) reduce to 
(4.27), (4.28), (4.29). 

(ii) A BIB design I) with b treatments, v blocks, k replications, block size 
r, and A =* 1 is clearly a partial geometry (k, r, r). The dual design D* t viz. the singly 
linked block design, based on the SLB scheme corresponding to D is therefore the 
partial geometry (r, k, r) duai to the partial geometry (k, r, r). Hence a singly linked 
block design with parameters (4.19), (4.20), (4.21), (4.22) is a partial geometry (r, k, r). 
The geometric association scheme, with characteristics (r, k, r) is identical with the SLB 
association scheme, und in particular the geometric association scheme with characteristics 
(2, wi—1,2) is identical with the triangular association scheme. It is easy to verify 
that the formulae (7.3), (7.4), (7.5) reduce to (4.19), (4.20). (4.21) by putting t ^ r, 
and to (4.0), (4.7), by putting l = r — 2, k — m— 1 . 

(iii) We shall conclude by giving a rather less obvious example of a partial 
geometry. Consider an elliptic non-degenerate quadric Q & , in the finite projective space 
PO(b, ;>"). This quadric is ruled by straight lines, called generators, but contains no 
plane. As shown by Primrose(1951) and Ray Chaudhuri (1959 ; 1962a) there are(^-f-l) 
(s+1) points and (s 3 +1)(«*4-1) generators in Q h . Each generator contains s-f -1 
points, and through each point pass s*- f-1 generators, where s = p\ If P is a point 
on <? 5 not contained in a generator /, then the polar 4-space of P intersects l in a single 
point P , and PP* is a generator of <? s . It can be verified by using theore proved ms 
by Ray Chaudhuri that PP % is the only generator through P, which intersects l. 
Considering the points and generators of Q i as points and lines, we have a partial 
geometry (s 2 +l, s+ 1 , 1 ). The corresponding PBIB design was obtained by Ray 
Chaudhuri (1959, 1962), the special case s = 2 having been obtained earlier by Bose and 
Clatworthy (1955). J 

In the same way one can show that the configuration of points and generates 
on a non-degenerate quadric Q 4 in PG( 4, p") is a partial geometry (,+ . s+ 1 n 
where s - p\ The corresponding design was first obtained by Clatworthy ( 1952 ; 
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S. Pseudo-geometric association schemes and uniqueness and 

EMBEDDING THEOREMS 

A two class association scheme, which has the parameters (7.3), (7.4), (7.5) 
and for which the inequalities 

1 < t < r, 1 < < < * 

are satisfied is defined to bo a pseudo-geometric association scheme with characteristics 
(r, A\ /). Thus a pseudo-geometric association scheme with characteristics (r, A*, t ) 
has the same parameters as the geometric association scheme with characteristics 
(r, A - , /), viz., the association scheme of a partial geometry (r, A*, /). However an asso¬ 
ciation scheme may bo pseudo-geometric without being the association scheme of a 
partial geometry (r, k, t ). 

In particular a two class association scheme with characteristics (r,k,r —1) 
may bo called a pseudo-L r scheme. It has the same parameters as an L, association 
scheme. Similarly a two class association scheme with characteristics (r, k, r) may 
be called a pesudo-SLB scheme, and in particular a two class association scheme 
with characteristics (2, m—1,2) may be called a pseudo-triangular scheme. 

(a) A subset of treatments of an association scheme G, any two of which 
are first associates is defined to bo a clique of G. When G is the association scheme of 
a partial geometry thcro will exist in G a set E of distinguished cliques K x , K 2 , • 
corresponding to the lines of the geometry satisfying the following axioms : 

A* I. Any two treatments of G which are first associates are contained in one 
and only one clique of E. 

A*2. Each treatment of G is contained in r cliques of E. 

A*3. Each clique of E contains k treatments of G. 

A’4. If a is a treatment of G not contained in a clique K { oi E, there are 
exactly t treatments in K { which arc first associates of a. (t =* I, 2, 

Hence any association scheme G in which there exists a set E of cliques K lt 
K 2 , .... K b , satisfying axioms AM-A*4 is a geometric association scheme with charac¬ 
teristics (r, k, t), and we can base on it a PBIB design for which the second kind of 
parameters aro 6, r, k, A, = 1, A 2 = 0, where b is given by (7.2). 


One may consider two class association schemes in which there exists a set 
E of cliques K x , K 2 , .... K h satisfying one or more but not all of the axioms A*l, A*2, 
A*3, A*4, and investigate under what additional conditions they will be geometric 
association schemes, with characteristics (r, k, /). Thus the result obtained at the end 
of Section 7(c) may be rephrased as : If there exists in an association scheme G, a set 

E of cliques K lt K 2 . K b , satisfying the axioms AM, A*2, A*3, and if r < k, then 

G is a geometric association scheme with characteristics (r, k, t ). 

Again one can prove (Bose. 1963) the following theorem : Let G be a pseudo- 
geometric association scheme with characteristics (r, k, I). If it is possible to find ,n G 
a set £ of cliques K„ K 2 , , K t , satisfying axioms AM and A'2 and ,f r < k, then 


G is a geometric association scheme. 
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(b) Generalizing a result of Bruck (1963) regarding the pseudo-L r scheme, 
Bose (1962: 1963) proved the following result : 

Let O be a pseudo-geometric scheme with characteristics (r, k, <), for which 

k > p( r , t) = «r(r-l)+/(r+lKr*-2r+2)J ... (8.1) 

then G is a geometric association scheme. 

In other words if (S.l) is satisfied, then we can find a set of cliques in G satis¬ 
fying the axioms A*l, A*2. A*3, A*4. Taking these cliques to be linos, and the 
treatments to be points we get a partial geometry (r, k, t ). 

(c) Consider the special case r = / = 2, k — w— 1 of the theorem of sub¬ 
section (b). Then p(r, t) = 7. Remembering the results of Section 7(o)(ii), it follows 
that a pseudo-triangular association scheme, i.e., an association scheme with parameters 
(4.6), (4.7), must be a triangular association scheme if m > 8. This result is duo to 
Connor (19. r >4), who expressed it by saying that the triangular association scheme is 
unique if m > 8. 

Shrikhnnde (1959a) proved the uniqueness of the triangular association scheme 
for m = 5, 6; and Chang (1959) and Hoffman (I960) proved the same for m - 7. 

Both Hoffman (1960) and Chang (1960) have shown that for m = 8, the 
parameters (4.6), (4.7) do not completely determine the association schoino. Thoro 
arc three other possible schemes with the samo parameters besides the triangular. 
This may be expressed as follows : 

There are four non-isomorphic two class association schemes (including the trian¬ 
gular) with parameters 


Consider a BIB design with parameters 

v * = *( m “!)(»*—2), 6* = im(m — 1 ), r* * m, k * m—2, A’ = 2 


( 8 . 2 ) 


(8.3) 


Hal1 and Connor C9«) have shown that if this design exist, then i, can be 
embedded tn a symmetric BIB design with parameters 


v 0 = 6 0 = *m(m-l)+l, r 0 = * 0==n , A 0 


2, 


... (8.4) 

One important consequence of Hall and Connor s embedding theorem is that 
it wm To ' A ( 'i ^ ,' mphCS th ° non - existcnce of ( 8 -3). For example if m = 10 

- —— •< «• bib A; Av v- a* ~ T, 

s.™,. ^ *... h.u „ ^ SSL, “ «:* ; k “ 
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uniqueness of the triangular scheme. It is interesting to observe that m = $, the 
case not covered in Hall and Connor's entirely different proof is exactly the case when 
the parameters (4.6). (4.7) do not uniquely characterize the scheme as triangular. 

(d) Xow consider the special case t = r— 1, of the theorem of sub-section 
(b). Then 

p{r, 1) = 4<r-l)(r*-r*-r-H2). ... ($.5) 

In particular if r = 2. p{r. t) = 4. Remembering the results of Section 7(e)(i). it follows 
that a pscudo-L, scheme. i.e.. an association scheme with parameters (4.27). (4.2$). 
(4.29) is an L r scheme provid'd that 


k > *<r-l)(r*-r*-r-r-2). 


(S.6) 


In other words if (S.6) is satisfied, and a two class association scheme with 
parameters (4.27). (4.2$). (4.20) exists, then we can arrange the k* treatments in a kxk 
square scheme, and find a corresponding set of r—2 mutually orthogonal Latin squares, 
such that two treatments are rir*t associates if they occur together in the same row 
or column of the square scheme, or correspond to the same symbol of one of the Latin 
squares, and are second associates otherwise. This result may be expressed by say¬ 
ing that th' L r association scheme is unique ichen r = 2 and unique up to type when r > 2. 
if ($.6) holds. In the case r > 2. it is necessary to add the words unique up to type 
because in general there will exist many non-isomorphic sets of r — 2 mutually ortho¬ 
gonal Latin squares. The uniqueness result for the L. scheme is due to Mesncr (1056) 
and Shrikhande (1050b). and for the general case L, (in a different language) to Bruck 
(1063). A slightly weaker result for the uniqueness of the L f scheme was proved 
earlier by Mesner (1056). the bound ($.6) due to Bruck being sharper than Mesner s 
bound. 

(e) Again let us consider the special case t = r of the theorem of section 
(b). Then 

*r<r»-r»+r+l>. - <*- 7 ) 


Remembering the results of Section 7(e)(ii). it follows that a pseudo-SLB 
scheme, i.e., an association scheme with parameters (4.19), (4.20). (4.21) i-s an SLB 
scheme if 

t > i<f»-r»+r+l). — < 8 - 8 > 


In other words if (S.S) is satisfied, and a two class association scheme exists 
with parameters (4.19). (4.29). (4.21). then there will exist a singly linked block design 
D- (dual of some BIB design D with A = 1). such that two treatments are first asso¬ 
ciates if thev occur together in the same block of D‘ and second associates if they occur 
together in'different blocks. This result may be expressed by saying that OtSLB 

JUffon scheme is ««w‘ to to* <f < 8 - 8 > «• ^ ** 

words up to tvpe because there exist in general non-isomorphic BIB deigns D, w,th 
the same parameters, who.- duals V are in consequence non-isomorphic. 
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(f) It is now clear that the result of sub-section (b) can bo viewed as a genera¬ 
lized uniqueness theorem. Wo may say that if there is a tux, doss association scheme 
ivith parameters (7.3), (7.4), (7.5), then if 

k> |[r(r-l)-f/(r-fl)(r*-2r+2)] ... («-9) 

then the association scheme is unique up to type, in the sense that there will exist a partial 
geometry (>\ k, t ) such that two treatments will be first associates if aiul only if the corres¬ 
ponding points are incident with the same line of the. geometry. 

(g) It is well known that there cannot exist more than k— 1 mutually ortho¬ 
gonal Latin squares of ordor k. A set of k—l mutually orthogonal Latin squares of 
order k is called a complete sot. 

Given a set S of r —2 mutually orthogonal Latin squares of ordor k, we 
may define 

d = (*-l)-(r- 2 ) = k-r+\ ... (8.10) 


to be the deficiency of the set-. If there exist d now Latin squares, such that when 
added to the original set S of r —2 mutually orthogonal squares, all the squares of the 
extended set. are orthogonal, then it would be possible to extend the set S to a complete 
set.. 


Shrikhande (1961) proved that if k at 4. then a set of mutually orthogonal Ijatin 
squares of order k and deficiency 2 ran be extended to a complete set. Bruck (1963) 
generalized this result and showed that if 


k> j(d-l)(rf*-d*+d + 2) ... (8.1,) 

then a set of mutually orthogonal Latin squares of order k and deficiency d can be extendcl 
to a complete set. 

We shall here prove the following generalized embedding theorem and derive 
from it the results of Shrikhande and Bruck. 

Given a two class association schemo O with the paramotors 

v - *t(d—!)(*—!)+!]/(, « (d—IK*—1)//. ... = d(fc—1) ... (8.12) 




d(k-t-l) 


dt 


.. (8.13) 


P 2 = ( (<*-lX*-/X*-f-l)/< (d-1 K*-0 \ 

\ (<*-!)(*-<) (f-l)(d_l>+(*_2 )) 


... (8.14) 


aiui a PBIB design based on this association scheme, with r replications, block size k 
and A, > A,, then we can extend the design by adding new blocks containing the same treat¬ 
ments, in such a ivay that the extended design is a BIB design, ivith r 0 = r +d(A -A ) 
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xplications, block size k. anil in which even/ pair of treatments occur together in A, blocks, 
provided that 

k > p(d, t) = Hrf(d-l)+/(d+l)(d*_2d+2)]. ... (8.15) 

It is readily verified that the parameters of G satisfy the necessary identities, 
(2.2). (2.3), (2.4). Lot G- be the complementary of G. i.e.. G • is the association scheme 
with the same treatments as G, but a pair of treatments which are first associates in 
G, are second associates in G\ and a pair of treatments which are second associates 
in G are first associates in G\ The parameters of G * are obtained from G by inter- 
changing the subscripts 1 and 2 . 


Hence for G 

v* = *[(«/-IK*-1) + /]//, = d(*-l), nX = (<f-iK*-lX*-l)/f 

p . = / P-W-U+*-* (d-l)(A—/) \ 

\ ( rf - 1 X*—0 id- 1 K*-#X*-<- 1 )H ) 


(8.16) 

(8.17) 


PI 


dt 


d(k-t- 1) 


d(k-t-l) 


( d-lK*-lK*-0 


—«/(*—/—l)—l 


... (8.18) 


Comparing with (7.3),(7.4), (7.5). we see that G • is a pseudo-geometric associa¬ 
tion scheme with characteristics ('/. A*. /). In view of (8.15), it follows from the theorem 
of sub-section (b), that G • is geometric. From (7.2) the corresponding partial geometry 
has </[(</— 1 )(*— l)-f t]/t lines or blocks, and every pair of treatments which are second 
associates in the original PBIB design occur together once in the blocks of the partial 
geometry. If we add these new blocks repeated A, — A 2 times to the blocks of the 
original PBIB design, then each pair occurs A, times and each treatment occurs 
r+</(A,+A 2 ) times. This proves the required result. 

We note that by taking 


t = k—r, d = k+l—r 


(8.19) 


the parameters (8.12), (8.13). (8.14) reduce to (4.27), (4.28), (4.29). Now suppose that 
a set of r —2 mutually orthogonal Latin squares of order k arc given, then the L, asso¬ 
ciation scheme corresponding to these, together with the corresponding lattice design 
satisfy the conditions of our generalized embedding theorem, where t and d are given 
by (8.19). Note that d is the deficiency of the set and A, = 1. A 2 = 0. The condition 
(8.15) now reduces to (8.11). If this condition is satisfied the lattice design can be 
extended, by adding new blocks, to a BIB design with parameters v 0 = k 2 , k 0 = 

= r+( * + i_r) = *+l, A 0 = 1. Then b 0 = k 2 +k. However such a design is 
equivalent to the existence of an affine plane of order k, or a balanced lattice with *+1 
replications. The new blocks added consist of k+l-r or d complete replications 
from each of which we can derive a Latin square. The additional Latin squares are 
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orthogonal to each other and also to the r—2 Latin squares of the original set. Wr 
have thus proved Brock's (1963) result that if (8.11) is satisfied a set of mutually ortho¬ 
gonal Latin squares of order k and deficiency d can be extended to a complete set. 
Shrikhande’s result (1961) is the special case d = 2 . 
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LATTICE SAMPLING BY MEANS OF LAHIRI'S 

SAMPLING SCHEME ( 

By TORE DALENIUS 
University of Stockholm 
and 

The Sire dish Council for Social Science Research 
I. Introduction 

1.1. Professor P. C. Mahalanobis and the development of sample survey tin ory 
and methods. India won early world-wide recognition as one of the leading nations 
in the development of saiuplo survey theory and method*, which manifested itself 
in the 1920’s and subsequently has continued. To a great extent, India won this 
position through the excellent work of Professor P. C. Mahalanobis and his colla¬ 
borators at the Indian Statistical Institute. 

1.2. The purpose of this paper. It is the purpose of this paper to illustrate, 
by means of an example, the groat potentiality of an ingenious sampling scheme which 
was developed in the 1940'* by one of Professor Mahalanobis collaborators, but which 
still appears to be relatively little known in wide circles of statisticians. More speci¬ 
fically, this paper has a two-fold purpose: 

(i) first, to give a general exposition of Lahiri's scheme for selecting a sample 
with probability proportional to an "overall ' measure of size, as discussed in Lahiri 
(1951); and 

(ii) second, to demonstrate the applicability of Lahiri's scheme to lattice sampl¬ 
ing. 

The emphasis of the paper will solely be on the selection aspect; problems of 
estimation will not be discussed. 

2. A GENERAL EXPOSITION OK LAIIlKl's SAMPLING SCHEME 

2.1. Lahiri's scheme. Consider a population of .V sampling units and their 
associated measures of size 

U x ... Uj ... U„ 

A x ... Aj ... Af/. 

In Lahiri (1951), a scheme was presented for selecting a sample of n distinct 
sampling units in such a way that the probability of getting any specific outcome 

is proportional to the sum of the corresponding measures of size 

_ We will refer to £„ as the overall measure of size of the sample.* 

• It is interesting to observe that in the years around 1930. several authors — obviously imtepon- 
dontly of each others - developed schemes for selecting a sample with probability pmjrortional to „„ 
overall measure of size. Thus, such schemes were presented in H*jek (1949). Horvit* and Thompson 
(1952), Midzuno (1952) and Sen (1956). 

7 
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Lahiri's scheme for n = l. In the interest of increasing the lucidity of 
01,1 exposition, we will first discuss the special case represented by n = 1. For this 
simple case, Lahiri's scheme is as follows. 

We consider the population of N sampling units and their associated measures 
of size, as specified in paragraph 2.1. L-t .4 0 be a number not smaller* than any one 
of these measures of size, i.e. 

.•I 0 ^ Aj for all J. 

Lahiri s scheme for selecting n = 1 sampling unit with probability propor¬ 
tional to the corresponding measure of size is as follows. 

(i) Select, with equal probability, an integer R x in the interval (1, X), that 
is such that 

1 < *» < iV. 

To bo specific, we assume that the result is R x =* K. 

( ii) Select in a regular table of random numbers a number R t such that 

0 < R 2 < A 0 . 

(iii) If R 2 < A k . then U K is selected. 

(iv) If, however. R 2 > .-I*, then U K is not selected. In this case the pro¬ 
cedures (i) and (ii) are repeated: clearly. U K may be selected in the course of such a 
repetition. 

It is easy to demonstrate that the probability of selecting Uj by this scheme is 
proportional to the corresponding A Jt J =» I ... .V. 

It may prove instructive to present Lahiri's scheme with reference to the 
following Figure I. 



U, Up u 3 Un Un 

Fig. I. 


•As shown in l.uliiri (Ittfl). this condition is not essential. It will b© used hot©, Iiowovor, to 
jnvuctvo tlie simplicity of tlic pre-dilation. 
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The soloction of corresponds to tho selection of one of the .V positions 
marked ... U s on the U- axis. The selection of R . corresponds to the selection 
of a point on or above the vertical line at IJ 

From the point of view of its practicability. Lahiri's scheme has two important 
characteristics. 

(a) Instead of selecting a sampling unit indirectly, via the selection of the 
integer R t . it is possible to carry out this selection dirrcJly. In order to clarify this 
point, we consider a simple urn-scheme. An urn contains .V halls. \Ve select one 

of these halls at random, with probability * for any one hall to he selected. Thcrc- 

•V 

after, we proceed as discussed in the points (ii)-(iv) above. Clearly, the halls do not 
have to he numbered in this case. 

(b) It is not necessary to specify, prior to the selection of R v the individual 
measures of size of the .V sampling units; it is sufficient to be able to specify A„. 
Wo must, however, be prepared to specify this measure for any one of the N 
sampling units that happens to be selected. 

2.3. Lahiri's scheme for n > 1. We consider once again the population of 
N sampling units and their associated measures of size, as specified in paragraph 
2.1. Let S 0 be a number not smaller than the sum of the n largest measures of size. 2 

Lahiri's scheme for selecting a sample of n sampling units from the jiopnlation 
specified above, with probability proportional to the sum of the corresponding 
measures of size, is as follows: wc introduce at once a device for direct selection of the 
sample, analogous to the one presented in paragraph 2 . 2 . 

(i) Select, by simple random sampling without replacement, a sample of 

n sampling units. These units havo measures of size A. ... A 

1 •• 

This operation corresponds to the selection, with equal probability, of an integer 
R x in tho interval (1 ,C») such that 


i < * i < c: 

sample i ^ 0nti ^ CAt '° n ° f * h ° 8ami> * e in a register listing all Cif possible 

(ii) Select a random number R : such that 

0 < < S«. 

(ui) If + sample number R, is selected to serve as the 


sample. 


»It is interesting to observo the formal resemblance botwon 1 -Hi - . ~ 

Oarlo technique for estimation of tho value of an integral. ' * >c,,cme Rnd R «•■*•*»» Monte 

2 Again, thia condition i. not essential, as shown in Lahiri ( 1951 ). 
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(iv) If, however, R, > A, +A „, the n sampling units arc replaced; 
in this ease, the procedures (i) and (ii) are repeated. 

This sampling procedure is completely analogous to the one considered in 
paragraph 2.2 : the possible samples of the present procedure play the same role 
as do the .V sampling units in the sampling procedure discussed in paragraph 2.2. 

3. Applying lahiri's sampling scheme to lattice sampling 

3.1. Lull ice sampling. The previous presentation of Lahiri’s scheme has been 
restricted to the simplest kind of a sample design. In Lahiri (1951), it was indicated, 
however, that the idea underlying Lahiri's scheme may be applied to more complex 
designs. 


In this section, wo will demonstrate the possibility of applying Lahiri’s 
scheme to lattice sampling. For a definition of lattice sampling, wc quote from Yates 
(1953, p. 356) : 


“If we have a square area of side p, divided into p 2 unit squares, wc can select 
a sample of p unit squares in such a manner that every row and every column of the 
large square contains one of the selected unit squares. Such sampling is a special 
type of double stratification without control of sub-strata... . The rows and columns 
of the square can represent any two-way classification of the material in which there 
are equal number of classes in the two classifications and one unit in each sub-class. 

Similar schemes are possible for three or more way classifications.” 


According to Yates (1953, p. 357), lattice sampling “is of particular use when 
the material to be sampled is of a type that lends itself to multiple subdivision on a 
square or cubic pattern.” A typical example is the following situation discussed in 
Bryant. Hartley and Jensen (I960). These authors point out that “one may encounter 
populations for which there are two effective stratifying criteria, both of which arc 
desirable in a sample design. However, the number of permitted observations may bo 
less than the number of strata formed by the usual double stratification technique. 
More specifically, it may be desirable to utilize two-way stratification by constructing 
L = J JX • L t strata, but the permissible sample size n is less than L. 


By its very structure, lattice sampling should, in addition, prove useful for the 
design of a two-dimensional mapping survey. 

The concept of a mapping survey was introduced in Mahalanobis (1944, P-336); 
it was further developed in Mahalanobis (.952). There, Mahalanobis considers what 
h* calls a "field of a single variate. *. about which it is dcs.rcd to collect ,..format on 
|,v sample surveys. For convenience of discussion it is assumed that the field ,s 
finite and consists of .V elementary units which are arranged m, say, a linear or one- 
di.nensiu.ml order so that the elementary units can be numbered m a aerial order 

1, 2, 3, .... -V." 
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It is characteristic of the purpose of a mapping survey that the info.mat ...n 
sought “has explicit reference to the serial order or the relative location <•;»<•1 «• «- 
mentary unit with respect to other units, that is to the manner in which the r-valuos 
are dimensionally distributed over the field. For example, one may be mten-sto.l 
to investigate whether the x-values are continually increasing or decreasing, or fluc¬ 
tuating in any regular manner, when one passes (in serial order) from one end 1o Mu- 
other of a one-dimensional field: or to ascertain the variance function for sampling 
units which are clusters (of various sizes) of consecutive elementary units. 


Malmlanobis continues as follows: “A class of investigation of the second type, 
to which special attention may be drawn, is the problem of preparing what may In- 
called a map of the field showing the dimensional distribution of the .r-valnes over the 
field,... In this ease, the sample design must include rules for estimating the 
^-values separately and individually for the remaining (.V —w) non-sample units, 
on the basis of the ascertained .r-value* for the n sample-units." 


In Hansen. Hurwitz and Madow (1033. Vol. I. p. 4«3). the related problem 
of preparing “estimates for a number of individual areas on the basis of direct measures 
of the desired characteristic for only a sample of those areas, together with a knowledge 
of some related characteristic for each individual area" is discussed. 


As an illustration of a two-dimensional mapping problem, wc consider the 
following example. We want to classify the administrative units, into which a country 
is divided, into G groups of units which aro internally homogeneous with respect to 
one or several variates associated with the unite: each group of units must be geographi¬ 
cally compact. A realistic case may l»c that we want to divide a country into a few 
districts which arc internally homogeneous with respect to the cost of living. It seems 
reasonable to assume that lattice sampling can be used to a great advantage in such 
a case. 


3.2. fjattice sampling by means of Lahiri's scheme. In this paragraph, we 
will illustrate the applicability of Lahiri's scheme to lattice sampling of the square 
type. In the interest of emphasizing the basic idea, we will assume that the 
number of sampling units in the population is N = n*. » being the permissible sample 
size. 


Wc divide our population of N sampling units into n* strata, by means of two- 
way stratification, using n strata for each one of the two stratifying criteria. 
Following Yates (1953), we may represent the outcome of this stratification by means 
of a square area of side n, divided into n* unit squares; one sampling unit is placed 
on each such unit square. 
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\\ o denote the sampling units by U nc and their respective measures of size 
*\ v -**««•• R = I. ... w. C* = 1 ...n. Figure 2 illustrates the case n = 3. 
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Fig. 2. 

We wish to select a sample of n sampling units, with probability proportional 
to the overall measure of size, subject to the restriction that one and only one sampling 
unit is selected from each "row-stratum", and one and only one sampling unit from 
each "column-stratum ", that is. subject to a "Latin square restriction." 

Figure 3 illustrates, for the case n = 3, a possible outcome of such a select ion. 



Fig. 3. 

There are nl different sets of n sampling units compatible with the restriction 
stated above. For each such set. there is a corresponding overall measure of size. 

Lahiri's scheme may now be applied ns follows. 

(i) Select one of the »! sets mentioned above. The selection should be carried 
out in such a way as to give each one of these n! possible outcomes an equal probability 
of being selected. This can be done as described in Bryant. Hartley and Jessen (1000, 
p. 110). This selection corresponds to the selection of the random number R lt with 
1 ^ i?, ^ «!. as discussed in 2.3. 

We denote the outcome of this selection by 

A u .... A mJ . 

(ii) Select a random number Ii 2 . with 0 < Ii 2 < S 0 , where 6' 0 is not smaller 
than anyone of the »! overall measures of size of the corresponding sets of sampling 
units. 


LATTICE SAMPLING BY MEANS OF LAHIRI’S SAMPLING SCHEME r,r, 

(iii) If R 2 < A u +...+A^, the sum of the measures uf size for the w sampling 
units making up the outcome in step (i). this set of sampling units makes up Ihc sample. 

(iv) If, however. R 2 > A u +...+A mf , the set of sampling units is replaced; 
as before, the procedures (i) and (ii) are repeated. 

Again, this sampling procedure is completely unnlogous to the ones considered 
in paragraphs 2.2 and 2.3. The n! different sets of sampling units play the same role 
as do the N sampling units in the sampling procedure discussed in paragraph 2.2 and 
the CH possible samples in the sampling procedure discussed in paragraph 2.3. 

3.3. Here we will relax the rather unrealistic assumption that .V = a-, 
where n is an integer. The fact that X ^ «* means that wo have 

q* < X < r* 

where q and r arc positive integers. We will present three different ways to deal with 
this situation. 

(i) Wo may uso a </ 2 -schomc. In order to do so, we have to consolidate 
some sampling units into larger ones; the size of such a unit cijimls the sum of thu 
measures of size of the original units making it up. 

(ii) We may uso a r*-scherue. One possibility is to introduce r 2 —N "dummy 
units," eaoh one with zero mcasuro of size. Another possibility would be to divide 
some sampling units into e g. 'half-units' and treat these 'half-units' as sampling units 
in their own right; this would call for a corresponding division of the respective measures 
of size. 


(iii) We may use stratified sampling. The N sampling units aro divided into 
two or more strata; each stratum is thereafter dealt with as described in paragraph 3.2 
or in points (i) and (ii) above, as the case may be. 

3.4. Further generalization,. The di*cu*sion in paragraph* 3.2-3.3 can ho 
generalized to lattice sampling. „f the third and higher dimension in a perfectly 
straightforward maimer. ^ J 
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ON SOME OF THE CONTRIBUTIONS OF 
INTERPENETRATING NETWORKS OF SAMPLES 

Bn W. EDWARDS DEMING 
Consultant in Statistical Surveys, Washington 

Breadth of APPLICATION 

It is a special pleasure aiwl privilege for mo to present a paper in 
honour of Professor Mahalanobis, as for U years I have used only interpenetrating 
networks of samples (IPNS), initiated by him. as everyone knows, about I1»3«. 
Applications in my own work cover many type* of samples of human populations in 
several countries for studies in consumer research, labour force, morbidity, evaluation 
of inventory in process, measurement of physical deterioration of plant and buildings 
belonging in public utilities, studies in the fertility of schizophrenics, psychological 
problems of the deaf, studies of mental retardation, estimates of the costs of operations 
(e.g., switching railway cars), cost of installing certain types of equipment, usage of 
telephone circuits, studies of the characteristics of rail and motor freight, air passenger- 
traffic, census information, early tabulation of complete censuses, agricultural pro¬ 
duction, studies of housing conditions, and otherwise. 

Advantages of IPNS 

The main feature of IPNS is simplicity in the calculation of the standard error 
of an estimate. It also enables one to estimate rapidly the mathematical bias, if any, 
in the formula of estimation (vide infra). It helps to detect gross blunders in selec¬ 
tion, recording, and processing. It permits evaluation of variances between investi¬ 
gators, coders, and other workers in the various statistical stages of processing. A 
section further on deals with the detection of gross blunders. 

In a consumer-survey in the US, housewives answered questions (inter alia) 
with rospect to purchases of aluminium foil. The survey showed that Brand X, 
during the past year, had lost a good share of the market to another brand, which I 
will call Brand Y. On the other hand, shipments of Brand X from the factory had 
increased, and the manufacturer doubted the results of the survey. This was for 
Brand X a critical matter in plans for the coming year in resect to output, distri¬ 
bution, and advertising. It turned out later that the survey was correct : heavy 
shipments from the factory had represented increases in wholesale inventory, not 
demand by the consumer. Without standard errors, one could not be so sure that 
the results for Brand X indicated a real decrease for Brand X, and a real increase for 
Brand Y, and could not have given the manufacturer results for planning at the 
time when he needed them. 

8 
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Standard errors also serve as a guide to day-to-day improvement of survey- 
procedures. For example, I plotted standard errors of 50 characteristics computed 
irom the results of a national consumer-survey by the format shown further on. 
Forty-t wo of the standard errors fell between \/(pqln) and x/icpqjn), c being the size of 
segment (4 dwelling units to the segment in this case). Strangely, 8 standard errors were 
well above \/(cptj/n ). A standard error as high as \Z(cjttj/n) is possible if the c dwelling 
units within every segment gave solid answers, all yes or all no. Variance greater 
than /(cpqjn) indicates that the interviewers themselves were supplying some answers. 
A glance at the questionnaire showed that these s characteristics were questions 
about personal products, concerning which interviewers do not enquire: they guess, 
and put down answers. The standard errors thus indicated that the results for these 8 
characteristics were largely fictitious. Two courses of action were open: (a) retrain the 
interviewers, or (b) revise the questionnaire. Without standard errors at hand, 
these observations and improvements would not have taken place. 

One may lay out the sample so that pairs of subsamples are worked in the field, 
in the coding, and even in the punching and tabulating, by separate groups of workers. 
The pairs of subsamples are coni]>otitivc. Wide disagreement between the pairs of 
subsamples, compared with the variance within pairs, may indicate operational errors 
or gross misunderstanding of definitions or procedures, to be found and corrected. 
Use of subsamples in this way does not replace other statistical controls, but it has 
been very helpful in my own work, especially in the detection of gross blunders. 

Conversely, one may interpret a small standard error, where the design measures 
the total variance, including the variance between investigators, as indication of 
fairly uniform performance. 

A further ad vantage is important, when one uses IPNS in the form of the 
Tukey plan (vide infra), and that is easier communication of the procedure, and 
easier interpretation of results, to the nonstatistician. 

Detection of persistent errors and of gross blunders 

Various designs are possible for measurement of the variance between investi¬ 
gators. .Some designs give rise to low-power measurement of this variance, at little 
additional cost, as where a pair of sampling units in different subsamples are allotted 
at random to a pair of investigators. Each pair of sampling units yields one degree 
of freedom. Other designs give more degrees of freedom per sampling unit, but re¬ 
quire more travel, and cost more. No extended account is needed here, though a 
reference to Chapter 12 in my book .Sample Design in Business Research ( Wiley, 1060) 
might not be out of place. 

As an example of detection «»f a blunder in selection, I may cite a continuing 
study of motor freight in the US, the purpose of which is to estimate the distributions 
of shipments by type of rate, by weight-bracket, by mileage-bracket, typo of handling, 
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circuity, and other characteristics that affect costs and profits. As a regular part of 
the sampling procedure, the sample for each motor carrier is summarized for a month, 
and estimates prepared for certain grand totals, viz., number of shipments, pounds 
carried, and revenue, and compared with figures that come from the accounting depart¬ 
ment of the company. The purpose of these comparisons is to detect gross misunder¬ 
standings in procedure and in definition. 

This sample is laid out in 2 subsamples, wherefore the estimates from the 
2 subsamples should under good reporting bracket the figure from the accounting 
records half the time; both subsamples should be below the figure from the accounting 
records a quarter of the time, and both above it a quarter of the time, in a random 
manner. 


Such comparisons have disclosed a number of times the fact that some of the 
accounting department* have been reporting incorrectly, through misunderstanding 
of definitions (for example, confusion of line-haul with storage, actual weight for billed 
weight). The extra care that is possible with the sample detects errors in classification 
and definition that had caused biases month in and month out in the regular 100 % 
reporting. 

A run of successive months in which both subsamples fall short of the figure 
from the accounting records for the month indicates a persistent error, either in the 
sample, or in the accounting records. To savo space. I will not show actual figures 
for an example, but will only describe a nonparametric comparison whereby plu.s(-J-) 
indicates that the estimate from a subsample fell above the figure from the accounting 
records, and minus ( —) that it fell below. 

A run of negative signs in the TL-category (TL for truckload) was observed 
for one carrier. Although it is not the function of a statistical test to identify a cause, 
but only to detect the fact that a cause exists, if one exists, it is often true, as every 
statistician knows, that statistical test* do often point the finger pretty definitely 
at the source of trouble, as happened in this case. This motor carrier hauls a special 
commodity (steel) by whole truckload, under a special type of rate. The sampling 
unit is the freight bill for a shipment, a piece of paper about 5 by 7 inches with a serial 
number. The freight bills for steel arc printed in a different colour from the others, 
with a different run of serial numbers, and they aro filed separately, in filing cabinets 
of a different colour. The people that carried out the selection somehow assumed, in 
spite of careful admonition to study all traffic, that TL-shipments of steel were not 
subject to the sampling plan. The accounting department, however, reports revenue 
from all sources including steel: hence the persistent discrepancy. Agreement improved 
when TL-shipments of steel were sampled. 

The nonparametric test just described is simple but helpful. Other tests, 
some parametric, are also possible because of the replication provided by IPNS. 
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Brief description of the method 

One employs any type of sample-design, then replicates it /„• times with samples 
of size 1 k times the original size intended, with the use of paper zones. Each repli¬ 
cate is called a subsample. This sounds simple, am! it is. but it is necessary to observe 
that the l: subsamples must be independent. For example, for validity of the simple 
formulas shown further on, the system of selection must permit a primary unit to 
contribute to more than one subsample: the fact that one subsample fell into a primary 
unit must not preclude a 2-nd one from falling into it. However, the ultimate unit of 
investigation (for example, a household or group of households, or a segment of area) 
may be restricted to one subsample. That is. we may draw the ultimate unit without 
replacement and apply the finite correction factor 1—nfN to the estimate of variance. 

'fhe requirement that 2 random numbers be permitted to fall into one primary 
unit in order to validate the simple estimates of variance shown further along was 
first pointed out to me by my friend and colleague Professor John W. Tukey in 1940. 
I thereupon gave the name Tukey plan to the procedure of IPNX in its simplified form, 
with paper zones, now to bo described. 

For a brief description of the method, wo may use for illustration a national 
sample of the population, ns for consumer research, or for census data. 

The primary frame will be a list of areas with definite boundaries, such as 
counties or metropolitan districts. These areas will preferably be areas for which wo 
have recent Census-figures, although one must sometimes draw up plans without 
Census-figures, or with obsolete figures. If there are no figures at all, one may resort 
to the use of equal sizes, or sizes modified by judgment. 

In any ease, we show for each area the best available measure of sizo. 
We then decide on the size of the sampling unit, and cumulate sampling units in the 
primary frame. The next step is to decide the zoning interval for the paper zones; 
then to construct a sampling table, which will show the serial numbers of the sampling 
units selected for the sample within every paper zone. 

Every random number in the sampling table will fall into a primary area 
that is definitely identifiable. The next step is the same as in multi-stage sampling, 
viz... to break up the primary unit into portions, and to draw one or more portions, 
break them up. and continue nesting until local frames provide lists of the ultimate 
small sampling units (e.g., segments of area containing a number of dwelling units), 
random drawings of which will provide the workloads for interviewing. 

Paper zones contain a fixed number of sampling units. This number is called 
the zoning interval, Z. MZ is the probability that any specified sampling unit will 
fall into any designated subsample, and (when we draw without replacement) k/Z 
is the overall probability of selection. 

In a national sample, k would almost always be 2, to get maximum bonofit 
of geographic stratification. For smaller areas, such as a city or a few counties that 
are fairly homogeneous, I use 10 subsamples, for simplicity. 


CONTRIBUTIONS OF INTERPENETRATING NETWORKS OF SAMPLES <11 

Details of the procedure are not necessary in this paper, as I have described 
it with numerous examples in my hook Sample Design in Business liesenrch (W.ley. 
1060). 

One will of course stratify in the use of IPNS. just as he would in any other 
design. One may use systematic suhsamples. with h random si arts, for I: sul>- 
samples, if systematic sampling appears to he advantageous, or one may draw I: 
fresh random numbers in every zone where there is clanger of cycles (an over-present 
hazard, in my experience). The theory for the optimum size of segment and for the 
choice of sampling unit are the same as they are for any other sampling procedure. 

One may vary the size of the sampling unit, and may vary the size of segment 
within a sampling unit. For example, in areas where there are no recent maps, or 
where travel is expensive, or where carving is for any other reason especially difficult-, 
one may double the size of segment, or may avoid wide dispersion of segments. This 
will cut down on the number of segments that como into the sample, and will save 
cost of carving segments, and cost of travel. One may also double the size of I he sampl¬ 
ing unit in a primary area, and thus halve t he number of sampling units therein. Whnt 
this does is to decrease the probability that this county will contribute to tho sample, 
and decrease the cost of carving segments and the cost of travel in case a random 
number does fall into this primary unit. 

These alterations do not change the overall probability of selection, nor the 
procedure of tabulation. 

Example of format for calculation 

A convenient format for calculation of the standard error with 2 subsamples 
may be of interest, as local modifications thereof will fit- a variety of uses (see Table). 

This example comes from a national survey carried out with a replicated design. 
Let //(with appropriate subscript) denote the number of dwelling units in a segment, 
and x denote the number of women that answer yes. Use of dwelling units as the base 
permits use of figures from the Census for ratio-ostimates of the total number of 
females that would have answered yes to the question tabulated had the sample been 
100 per cent. 

The size of the survey in this example was small, being only about 1200 inter¬ 
views. The number of dwelling units in the survey (y = y x +y t = 1961 in the table) 
is not the number of interviews, but the number of dwelling units in tho 400 segments 
of area selected for the sample. The universe was female homemakers, and the ques¬ 
tion was this : “Do you make your own cake frosting at home?" Some dwellings 
had no female homeraakors whom the questions would apply to : moreover, there is 
always some nonresponse; hence the number y will be bigger than z. 


The 400 segments of area were not drawn as one sample, but as 2 independent 
samples, each of about 200 segments of area. Tho subscripts denote tho two subsamples 
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1 and 2. The symbols NE. NC. etc., in the heading denote Census regions—Northeast, 
North Central. South, and West. The sampling plan, including the formulas, are in 
Chapter 11 of my hook, cited earlier. 

The standard error calculated here includes the variable performance of the 
interviewers, as there was no attempt, in this instance, to randomize interviewers 
and subsamples in an orthogonal design for separate evaluation of the variance between 
interviewers. 
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Final eat i mate for the US. /»-.40; Mandnrd error .01. Upper and lower 1% fidnrinl limit*. .43 
and .37 respectively, baaed on 7 degree* of freedom. 

The results show p = .40 for an estimate of the proportion of dwelling units 
with women that prefer to make their own cake frosting at home, and a p = .01 for 
the standard error of this estimate (rather, for the standard error of the sampling 
procedure that gave p). The number of degrees of freedom in this estimate of the 
standard error is something less than 8 because the variances contributed by the dif¬ 
ferent geographic regions are unequal. 1 

The upper 1% fiducial limit, for the estimated proportion, based on 7 degrees 
of freedom, is .40 plus 3 standard errors, or .43. The fiducial 1% lower limit would be 
.40 less than 3 standard errors. The upper and lower 1 % fiducial limits of the estimated 
proportion are thus .43 and .37. _ 

iOne raav c»tiinat< 1 1..- number of degree* of fr.ccl.rn l.y .. formula give ■> by F. E. Sattcithv.itc, 
(1 * An approximate dialribution of climate* of variance components. Biomttrit*, 2, 110-114. 

Satterthwaite-a formula appears in the appendix to Chapter 11 of my book cited enrl.er. 
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The standard error of any other characteristic that the survey measured may 
be calculated in like manner. Usually, one calculates only the standard errors ol chief 
importance, such as the total dwelling units in the US (for comparison), the total 
number of purchasers of a product, one s share of the market, a chief competitor’s 
share, and possibly a few other characteristics. In this connexion 1 may add the fact 
that the estimate of the total number of dwelling units in the US, made from this 
survey, came out 2% short of the Census figure; ; or about l standard error short. 
One may possibly interpret this difference and its standard error as evidence that 
persistent undercoverago of assigned segments of area, if there be any, must have been 
of small magnitude. 


Estimates ok variance and of bias 
Estinuites of variance. The k replications (or k subsamples) give I: estimates 
.r, of Ex, k estimates of Ey, and k estimates /, of / (Ex, Ey). where /, is some 
function of a, and //,. Ltd .? be the estimate of Ex calculated from the whole sample, 
and define y. likewise. Let / denote f(x. y). 

Under the rules of selection stated above, we obtain an estimate of the variance 
of i by the simple form 


''* r •*“*(*- (*) 

[The sums run overall k subsamples] 
and an approximation to the variance of / = .i/y by the formula 

*•*/- (t-Ayp *<*-/»<)'■ - < 2 > 

In practico, we may simplify our estimate of the variance of any function / 
ovon further by merely calculating 


* * 
var / = 


2 (/,-/)■ 


(3) 


It is easy to increase the number of degrees of freedom, if it—1 is not enough 
(cl. my book cited earlier, pages 198 and 199). 

An improved estimate of Ex/Ey, together with its variance, appears further 
along, useful under the rare condition of troublesome bias in the estimate f(x, y). 

Correction of bias. I here adapt some theory of Quenouille* and of Durbin * 
along With suggestions privately com.nunicaUxUo me from Dr. Tukey, to illustrate a 

*M. H. Quenouille (1941): Approximate u 8 u ofand coniktteo _ i.»Timc.«ri, < ‘w 

Series II, 11, OS-SI; p. 70 in particular. M. H. QuonouiU© (1056)- Nolo _ ■ • . J ' ’* 

Bu.uu.rUu,, 43. 853-360. Sec H.n.oy L A 1,1 M L, U .b 1H 

•Valure, .74, 7 Augu.., .70, H. O. H„rU.y „„ dL A oJlZJnuL t 

catim.t«rs. J. A«*r. Sou. S3, ,91-508. Jol,„ W. Tukey <,f ." nb '"" tl 

not-quitc largo samples. Ann. Mali ,. S/a/.. 29. 614. d confidenco “» 
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graphical evaluation of the variance of a function, and an improvement in the esti¬ 
mate of the variance of a function of x, y. 

Suppose that we wish to estimate, by a sample-survey, the numerical value 
of some function f{Ex, Ey). Ex and Ey may both be unknown, but the sample fur¬ 
nishes estimates of either or both, hence also of f(Ex, Ey). A sample replicated in 
k subsamples, furnishes the estimates x 4 and y,- of Ex and Ey (i = 1,2, .... k). Each 
subsample, we suppose, is a valid sample of the whole frame. All k subsamples are 
precisely of the same design. They belong to the same probability system, and their 
results dill'er only because the selections of the sampling units in each came from 
different random numbers, and because accidental errors of performance introduce 
variation between subsamples. 

As an example, n might be the number of sampling units drawn into each 
suhsainplc. x t the number of packages of some product that the y { families in Subsample 
i purchased last week. Then f{x t , y,) might be xjy t , the average number of packages 
purchased per family. Or, x, might be the number of defective items in Subsample 
i, i/i the number of items tested, in which case f{x it y.) =x 4 /y i would be the so-called 
fraction defective. The function /(x, y) could of course have any form, such as xy 
for the area of a rectangle, x and y being the measured sides. 

Let x be any random vuriable with expected value Ex. Then 


x = Ex+Ax ... (•*) 

where Ax is the sampling error in x, and 

E Ax = 0 ... (6) 

E Ax* = o\ ••• (°) 

E Ax* = //„ ••• ( 7 ) 

EAx* = ,< 4m = M ... <»> 


with similar forms for y. Then for any function /(x, y) that possesses derivatives, 

f(x, y) = f(Ex, Ey) +/, Ax +f^Ay +/,«Ax 2 + 2f X¥ Ax Ay+f„Ay'+ . (0) 

where the subscripts on / denote derivatives evaluated at Ex, Ey. 

For a sample of size n sampling units drawn with random 

replacement 

A7C, a) =/(*•■•-. *V)+ £+-£+■•■ 

where 

A = E Ax 2 -| E Ay* + '~E Ax Ay = cr*+<rJ+2A’ Ax- Ay 
B = A’(A**+3Ax* Ay f 3Ax Ay 2 +Ay 3 ) 

C = E( At- 4 -fete.) 
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There will always be, for any function f(x t y) that possesses derivatives, a sample 
so big that the remainder after any term will be smaller than any pre-assigned number 
t. Just what this size of sample is depends on the number £, on the function/(x, //), 
and on the moment coefficients of the distribution of the sampling units in the frame. 
Thus the difference between E f(x, y) and f(Ex, Ey ). commonly called the bias in the 
sampling procedure, decreases with n. Hence, for samples sufficiently large (with 
proper assumptions about /). we may obtain a specified degree of approximation by 
writing 

Ef(x,y)=f(Ex,Ey)+AI". ... (12) 

Let there be k subsamples, n sampling units per subsample, n = kh sampling 
units in all k subsamples combined. We need now the symbols x (il , to denote 

estimates calculated from all subsamples excluding Subsample i. 

Let ... (13) 

Then Equation (12) with the full sample leads to the approximation 

/-/+» - < 14 > 

while with the estimate /. it leads to the approximation 

/ -“ /+ <ILTja’ ••• (16) 


Wo may solve those 2 equations for A and / finding that 

A-Mt-m.-h ... os) 

and /= */-(*-!)/. ... (17) 

We may tako / as an estimator of j(Ex, Ey). good to within powers of l/n a . 
In tho case of 2 subsamples, 

/=2/-l(/,+/,) ... (18) 

wh.oh QuenouiUe proposed in 1949, /, being/<*„ Vl ), and /, being /(*„ y t ). 

A simple graph illustrates the solution (see figure). The horizontal coordi¬ 
nates are the reciprocals of tho relative sizes of the samples that make up/ and /.. The 
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line drawn through the 2 points (1 /k,f) and (l/£Xr — 1],/.) intersects the vertical axis 
at l/k = 0, corresponding to infinite size of sample, where the bias would be 0. The 

intercept / is thus the solution of Equation (17) and is an estimate of f{Ex, Ey). The 

slope of the line is k{k— IK/*—/), which would be 0 if A were 0—that is, if there were no 

bias. The variance of / may be estimated as 



var [/„,-/.]* 

... (19) 

which is equivalent to 




. - 1 „ - 



* ar ! ~ mki) 

... (20) 

wherein 

S CO - */-<*“ !)/«>. 

... (21) 


SOME APPARENTLY UNCONNECTED PROBLEMS 
ENCOUNTERED IN SAMPLING WORK 


By DES RAJ 

Statistical Service of Greece. Athens 
I. Introduction 

Tho purpose of this article is to discuss a few apparently unconnected 
problems encountered by the author while planning sampling investigations and 
analysing the data so collected. These problems might also have been noticed by 
other workers who regularly design and analyse samples. The three main points 
discussed are : the need for median-unbiased estimators, the stability of the variance 
estimate in pps sampling and the number of random groups to be formed for making 
quick estimates of variances. 


2. The problem ok median-bias in pps sampi.ino 
For estimating population totals the usual method followed is to select tho 
sample with probabilities proportionate to size. By this device tho large variability 
in the sizes of the units is not allowed to inflate the sampling error. The contributions 
of the large and the small units to the sample total get normalised, so to say. But 
another consequence of this procedure is that tho sample gets concentrated in the 
large units; the probability is much more than oven that there would be many more 
larger units in the sample at the expense of the smaller units. Tho result is that the 
sample shows a persistent tendency to under-state or over-state certain items depend¬ 
ing upon the relationship between the value of the item and the size of the unit. An 
example will make this clear. Suppose a sample of communes is selected with pro¬ 
bability proportionate to population in order to estimate the total agricultural area of 
the country. Tho chances are very high that the sample will be dominated by the 
bigger (in the sense of population) communes. Now it will be found that bigger 
communes have proportionately (per person) smallor geographical area, i.e., the ratio 
of ?/ (geographical area) to x (population) is much smaller than the average. The 
effect of this would be that the sample estimate 


of the total geographical area of the country would turn out to be too low with a high 
probability. True it is that the estimate would bo unbiased in the mean in the sense 
that over all possible samples it would average out to the population figure But 
the point is that tho chances are more than even that the sample produces an under- 
estimate and we should bo prepared for that. It may bo pointed out that geographical 
area is not the only item that the sample will persistently under-estimate. Many 
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other items would fall in the same category. To put the argument into concrete 
terms, consider the following specific estimates (in some units) obtained during two 
different investigations in a country. 



enquiry 1 

enquiry 2 

geographical 

area 

agricultural 

area 

geographical 

area 

agricultural 

area 

census ligutc (r) 

I27.fi 

37.7 

127.0 

37.7 

(•ample estimate (a) 

1 10.7 

35.0 

1 IS. A 

31 .0 

relative *umpliitg error 

3.6% 

26% 

8.3% 

3.0% 

(«—«)/* 

— 13.2% 

-4.8% 

7.1% 

—16 0% 


In the first enquiry a sample of 425 communes selected with probabilities 
proportionate to population within about 100 strata was used to estimate the total 
agricultural area as given in the records. The sampling error was based on five 
random groups (see Section 4). The figures on agricultural area were collected 
from a sample of households spread over 250 communes selected on the basis of popu¬ 
lation in the second enquiry. In either case the data on geographical area woro copied 
down from the records. Both samples under-state, by varying amounts of 13 percent 
and 7 percent, the total geographical area. A study of the relationship between geo¬ 
graphical area and population showed that such a result was not unexpected when 
the sample contained a disproportionate number of large communes as a consequence 
of the use of pps sampling. 

The criterion of unbiasedness in the mean for sample estimators of population 
parameters has received the greatest attention in sampling theory and practice. There 
could bo situations, however, in which it is equally, if not more, important that the 
estimators ho unbiased in the median, i.e.. the chances are even that the sample pro¬ 
duces an under-or an over-estimate of the population parameter. It must be pointed 
out that this question is not peculiar to pps sampling although it was noticed by the 
present author in this particular setting. 


3. Stability of the variance estimate in pps sampling 
When a sample of size n is selected with replacement with probabilities pro¬ 
portionate to size, an estimate of the population total }' is givon by 


y « ? s & = — Sz t 

x i 


n 


n 


and the estimate of variance is taken as 




... ( 2 ) 


( 3 ) 


It can be proved (Des Raj, 1958) that the square of the coefficient of variation of u* 
is given by 

... (4) 









UNCONNECTED PROBLEMS IN SAMPLING WORK 
where fi r (z) is the r-th moment of the random variable 

z = ylv = Kyi*- 

This shows that the stability of the variance estimate u* in pps sampling depends, 
apart from the sample size, on the distribution of z and not on the distributions of // 
or x. Now the distribution of z can become highly skewed due to the presence of 
poor measures of sizo for which the ratio of y to x gets far out in the extreme tails. 
This is unavoidable in practice when there is no advance information on the size of 
2 for the various units in the population. The result is that the fourth moment of 
z gots inflated considerably while the second moment of z is kept relatively smaller 
(otherwise there is no justification for using pps sampling); both those factors have 
the effect of lowering the precision of the variance estimate M*. 

The observations made above will be substantiated with the help of an example 
taken from Cochran (1953). The problem is to estimate the total number of inhabi¬ 
tants in 04 large cities of the United States in the year 1930 by selecting a sample of 
cities with probabilities proportionate to thoir 192ft populations. The data are given 
in Table 1 below. 


TABLE I. POPULATION* OK 04 LARGE CITIES IN* THE U.S. 
(in t*nn of thousand*) 



1020 population (*) 



1930 population (y) 


80 

31 

17 

12 

90 

36 

21 

II 

77 

30 

17 

12 

82 

22 

18 

12 

7 ft 

30 

16 

12 

78 

33 

16 

12 

7.1 

26 

16 

12 

81 

30 

26 

ir. 

09 

26 

10 

12 

67 

29 

23 

14 

88 

24 

16 

12 

124 

29 

26 

12 

81 

24 

16 

12 

57 

26 

20 

13 

61 

24 

14 

II 

63 

29 

16 

13 

46 

24 

14 

II 

58 

31 

29 

10 

44 

24 

14 

II 

49 

27 

10 

11 

42 

22 

14 

11 

44 

28 

14 

II 

40 

21 

14 

11 

46 

26 

17 

11 

19 

20 

14 

11 

46 

27 

14 

16 

38 

19 

13 

10 

46 

21 

17 

12 

32 

18 

13 

10 

40 

20 

15 

12 

32 

18 

13 

10 

37 

26 

14 

13 






70 


DES RAJ 


The coefficient of skewness 


Vfii = ... ( 5 ) 

works out as 1.0 for the distribution of y but becomes as high ns — 26.6 for the distri¬ 
bution of z. The coefficients of kurtosis are 

Pit#) = = 480 . 

The second moment of z is relatively much smaller; the variance of the pps estimate 
based on a sample of size w is only 35 Jn while the variance based on equal probability 
sampling is 518 / m . The comparative stabilities of the two variance estimates can bo 
judged from Table 2 given below. 


TABLE 2. COEFFICIENTS OK VARIATION <%) OF VARIANCE ESTIMATES 


aiiraph* *iz«* 

••qunl 

probability 

PP" 

Miunplc »ir.p 

pqual 

probability 

PP* 

2 

202 

1558 

10 

123 

003 

a 

231 

1265 

20 

87 

490 

4 

108 

1005 

30 

71 

300 

5 

176 

980 

50 

55 

300 


It is clear that the standard error attached to the pps estimate would bo sub¬ 
ject to very largo sampling errors. This should be kept in mind while interpreting the 
results. 


4. Estimating variances by forming random groups 
It is now widely recognised that estimates based on samples should bo published 
along with their standard errors which give an idea of the stability of the estimates 
involved. Since the calculation of standard errors for each of a largo number of items 
is a laborious process, methods seem to be on the increase by which errors could be 
calculated more quickly with the attendant risk of some loss of efficiency. One such 
method being used consists in dividing the total sample into a small number of groups 
made at random and basing the standard errors on the group totals. If n is the total 
sample size, k groups may be formed each of size m where mk = n. If t { is an estimate 
of the population mean based on the *-th group, the estimate of the population mean 
based on the entire samplo is taken as 

F = ^5< j = f - («) 


and an estimate of the variance of 1 is given by 


= 


1 

*<*-!) 


siu-ir*. 


... (?) 


It is easy to see that, assuming sampling to be carried out with replacement, the square 
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of the coefficient of variation of v 2 is given by (see Hansen and others, 1953) 

l [/W- ] - ,K) 

where // 2 (/,) is the ratio of the fourth moment of the distribution of /,• and the square 
of the second moment. Using the fact that /< is the mean of //i observations on the 
variable y, a simple calculation shows that 

m -m + *Erl>. ... m 

m m 

Hence CVH*) - -I ... (10) 

If the entire sample be used for the direct calculation of standard error, the square 
of the coefficient of variation of the estimate of variance, a*, would be given by 

CFV) i(y»^)-»]+ 2 ,11) 

n n — i 

Thuswehavo CV\v*)-CV*(a*) - 2( ... (12) 

This shows that if the estimate of variance is baaed on k groups and not on the entire 
samplo, the square of the coefficient of variation of the variance estimute gots in¬ 
creased by 

2(n-*)/(n-l)(*-l). ... (13) 

Denoting by a and a' respectively the coefficients of variation of tho variance estimates, 
when no grouping is mado and when k groups are formed, wo have for large n 

a '-V5+“*- 

TABLE 3. COEFFICIENTS OF VARIATION (%) OF VARIANCE 
ESTIMATES BASED ON RANDOM GROUPS 


<*(%> 

2 

3 

4 

6 

e 

7 

8 

9 

10 

30 

146 

104 

87 

77 

70 

66 

62 

68 

66 

20 

143 

102 

84 

74 

67 

60 

68 

64 

61 

16 

142 

101 

83 

72 

66 

69 

66 

62 

49 

10 

142 

100 

82 

71 

64 

68 

66 

61 

48 

6 

141 

100 

81 

71 

63 

67 

64 

60 

47 

0 

141 

100 

81 

71 

63 

67 

64 

60 

47 
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In Table 3 are given some numerical magnitudes for a given value of a and a 
specified number of groups. Although the precision aimed at should depend upon 
the purposes for which it is required, a variance estimate with a coefficient of varia¬ 
tion exceeding thirty percent would by ordinary standards bo considered unsatisfac¬ 
tory. In that case, as is clear from Table 3. there is no hope of getting precise variance 
estimates when only a fow random groups are used. At least twenty three random 
groups are required to achieve reasonable variance estimates when the total sample 
size is fairly large. If oidy a small number of groups must bo used, the dogroo of 
reliability of standard errors should be made known to the users of the statistics pro¬ 
duced so that an erroneous impression is not created of the precision actually attained. 
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SCREENING PROCESSES : PROBLEMS AND ILLUSTRATIONS* 


By D. J. FINNEY 

Harvard University, U.S.A. and University of Aberdeen, Scotland 


Summary 

This papor reviews some of the circumstances in which screening processes 
are used for classifying large numbers of entities into two or more final classes. The 
screening may be done all at one stage, but commonly is multistage. In Section 2, 
I have discussed various types of entity, ranging from chemical compounds to human 
beings, according to their constancy or mutability of character between successive 
stages. I have next (Sections 3, 4) distinguished two main typos of screening, poly- 
tomous and regraded ; in practical circumstances, somo combination of these may be 
usod, but the mathematical consequences of such a combination will be very compli¬ 
cated and improved statistical techniques arc needed before realistic analysis is possible. 

After brief remarks (Section 5) about the common situation of having annual 
cohorts of approximately equal size for screening. I have considered (Sections 0-X) 
what is meant by “correct" allocation to classes, the use of scores for each stago of 
screening, the operating characteristic of a process (specifying the probabilities of 
all possiblo outcomes of the screening), and systems of values and costs for alternative 
processes. 

In Sections 0 , 10, I have outlined some of the ideas on screening of chemical 
compounds for therapeutic activity developed by Davies and Dunnctt. Compared 
with these are the screening of crop varieties (Section II). screening in education 
(Section 13), and screening based upon a multivariate criterion such as is often used in 
animal breeding (Section 15). In Section 12, the importance of close examination of 
operating characteristics is illustrated by presentation of such curves for alternative 
processes that might In- used with crop varieties. I have throughout subordinated 
presentation of mathematical technique to discussion of general principles; in Section 
14, however, are mentioned some of the publications that are relevant to the study 
of the frequency distributions generated by successive stages of screening. 


1 . 


Introduction 

In many widely differing fields of activity, schemes for choosing relatively 
small numbers of individuals from a large population, with the aim of finding those 
most suitable for some specified purpose, have been proposed and investigated. Often 
these are regarded as selection processes, as in the normal practice of testing large 
numbers of new strains of an economic crop in order to select a few that are most suit¬ 
able in yielding capacity or other desirable trait for subsequent exploitation. The 
separation of children into_different educational streams, and any subsequent 


This papor is tho revised and extended text of a contribute., to the Gordon 
on ••Sut.at.es in Chemistry and Chemic* Engineering”. July-Augns,. ,902. Confcrenec. 
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adjustments to correct early misjudgements, has many similar features; some educa¬ 
tionalists dislike the word ‘ selection” in this context, because of its implied deroga¬ 
tion of those who do not attain the highest level, and prefer a neutral term such as 
“allocation.” In the large-scale testing of chemical compounds for biological acti¬ 
vity, the word “screening” is commonly used, “selection” referring instead to a subse¬ 
quent phase of intensive trial for choosing the best one from a few previously found 
to be reasonably good. I shall adopt this useful word as the general term. 

Common to all these situations is the need to distribute a large number of 
entities between two or more categories, on the basis of some trait incapable of exact 
measurement ; all that can be done is to measure performance under standardized 
conditions, defined so that the measurement will be highly correlated with the ideal, 
and then to separate into categories in terms of this measurement. Such separations 
may be repeated on two or more occasions, perhaps with subsequent regrouping, in 
the hope of improving the approximation to the ideal categories. The central statis¬ 
tical problem is that of quantitative evaluation of the properties of alternative sets 
of specifications for these processes of screening, and the choice of an optimal scheme, 
within certain constraints; for example, there may be limitations on the proportions 
that must finally appear in some or all of the categories, or the total cost of screening 
may be restricted. 

I propose to discuss some of the questions that arise in any attempt to analyse 
and evaluate such screening processes. I shall mention complications that arise 
in screening for more than one trait, but initially I restrict myself to a single trait. 
Most of the work described was undertaken with a view to the improvement of parti¬ 
cular screening practices. The practical problems, however, have been idealized in 
order to remove inessential complications from the mathematical models. Un¬ 
doubtedly many precautions and qualifications must bo introduced before practical 
application of results based on these models, but no attempt will bo made to consider 
them in the present paper. 


2. Types of entity 

The first essential features of a screening process are that there shall ho onti 
ties to be screened and for each entity a sequence of k recognisable stages (includmg 
k - 1 as a possibility) at which screening is undertaken. The stages are usually 
points of time in the history of an entity. At each stage, a specified measurement 
of each entity is made, perhaps under standardize,! test cond.t.ons, and used in the 

screening (Section 6). 

The entities may belong to one of several types. Chemical compounds, 
to be screened for chemotherapeutic or other biological activity arc of the sunplcst 

’"TT Uv, V « the potato) or self-fertilized ,o.g. wheat,, for which successive gene- 
rafions pla.d'd and subjected to trial will maintain genet ,c identity within each var.oty. 
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A second important type of entity is that which of necessity suffers random 
or other modifications between stages of screening, although these changes are inde¬ 
pendent of the category in which an entity has been placed. The obvious biological 
examples here are varieties of cross-fertilized plants or selection lines of animals for 
which successive stages of screening are applied to successive generations. All genetic 
recombinations and segregations from one generation to the next introduce a new 
source of variation and tend to run counter to any gains achieved by selection. Deve¬ 
lopment of any theory of screening processes for such entities may prove excessively 
difficult, because to the purely statistical complications discussed in this paper will 
be added those of the quantitative biometric analysis of polygenic characters. Pause 
(1940) and Drifting (I960) have made interesting approaches to the subject, but much 
remains to be done. 

Another possibility is that the intrinsic nature of an entity remains fixed, 
but its true value in respect of the trait under study may he modified between two 
successive stages by the category in which it has been placed. Any form of educational 
screening might he expected to Ik* of this type. For example, one can regard a largo 
school, in which each age-group of pupils is divided between a number of parallel 
streams of different ability, as a regraded screening process (.Section 4). in which at 
the beginning of each year (or as often as promotions are made) a child may be moved 
to a higher or lower stream or continue in his own. To define the purpose of the screen¬ 
ing at all exactly is not easy : a suggestion that it was designed for guiding the allo¬ 
cation of the pupils to university or advanced technological courses in an optimal 
manner would doubtless he considered grass over-simplification. However, whether 
this or a vaguer aim "to give each child the best education within his capacity" were 
adopted, one would have to recognize that the category in which a child is placed 
temporarily may—indeed should—affect his later abilities. If a child of high academic 
ability is erroneously placed for a year in a relatively low stream, because of his mis¬ 
fortune in having a large negative error component at a particular screening, pre¬ 
sumably his ultimate suitability for university education will suffer, for if this were 
not so the merits of the streaming would be in doubt. Similarly, if a child of only 
moderate ability were by chance to be placed in a higher stream than he really merited, 
his suitability for different forms of advanced education would presumably bo 
changed. 

I do not know of any examples of the fourth type, entities that change between 
stages both because of random recombination of inherent properties and because of 
offects of the categories in which they were placed at the previous stage. 

A further important distinction between types of entity is that some have 
intrinsic values whether or not correct assessment of the trait under study would place 
them in certain desirable categories. Chemical compounds or new varieties of sugar¬ 
cane are of value only if they belong to "good” categories and screening classifies 
them correctly. An inactive chemical compound, or a new variety of sugarcane 
that is in no trait superior to those in use, is of no value, and even those compounds 
or varieties that are potentially valuable will be lost if screening errors cause them 
to be placed in a low final class. Here lies a fundamental difference from educational 
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screening, in which every child is rightly regarded as having value : there can be no 
question of discarding, or disclaiming further interest in. a child whose indifferent 
ability has been amply demonstrated. 

3. POLYTOMOOS SCREENING 

Two extreme types of screening process can be recognized. Typical of one is 
a sequence of dichotomies. For example, a large number of chemical compounds 
is to be screened in a search for the very few with therapeutic activity against some 
pathological condition. Although the ultimate interest may be activity in man,* for 
the present I suppose that a test of curative effect on a similar condition in an animal 
species is available. For any one compound, there is an unknown true mean in respect 
of the therapeutic activity; the mean value of a measurement made on a batch of test 
animals estimates this but with an experimental error. A reasonable scheme of screen¬ 
ing is to test all the compounds in low replication, a condition that is likely to give 
large experimental errors, to seloct a fraction P x as those showing the best performance, 
and to discard the remaining fraction (1— P x ) as being clearly valueless; the members 
of the selected fraction are then retested, so as to provido higher replication and lower 
experimental errors for them, and a fraction P s of these selected on the new measure 
of performance. This continues for k stages, after which a fraction tt of the original 
compounds remains, where 

n = P x P t ...P k . ... (3.1) 

Here at each stage the surviving entities are divided into two classes, one of 
which is discarded completely. No distinction is made between those discarded at 
different stages, all being regarded as equally valueless. It would bo possible to 
generalize the scheme by supposing that at each stage all previous classes nre dichoto¬ 
mized into “upper" and “lower” portions; finally, 2 * classes are recognized, that 
corresponding to "upper" at every stage being the one used in the previous paragraph, 
and each may have a different destiny. Still more generally, at stage r each existing 
class might be divided into e r new classes; finally there would be c x c 2 ... c k classes, 
identifiable by a label (i, » 2 ... i k ) where i x ranges over the integers from 1 to c x and 
so on. All these may be classed as polytomous screening, the dichotomous scheme with 
discarding of all lower classes being by far the most important. 

4. Regraded screening 

The other extreme can be illustrated by what may occur in a large school, 
where the number of children in any age group is sufficient to fill several classes. The 
natural procedure would be to maintain several parallel streams, so that the more 
able children of any age are kept together and either progress relatively quickly or 
have an enriched curriculum. Either at the beginning of each year when normal 
promotions are made or more often, children whose performance suggests that they 
;ir e in the wrong stream will be moved to a higher or lower stream; we may suppose 
that movement by more than one step is a negligib le possib ility, and also that the 

pr*>***ntecl an intorrating compariaon of drug ro*pon,es in mnn and animnl* 
,«n<l ha* found remarkably little correlation! 
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several streams arc to remain unaltered in size throughout. Symbolically, if there 
are C streams, entrants to the school are initially divided into C classes on the basis 
of any available information; the classes might indeed he equal in size, hut this is not 
essential. Then k stages of screening would involve matrices P x% P t , .... P k . each ol 
size CxC, having the properties: 

(i) PA'J) 'ho element of P r in row i, column j. is the proportion of children 
in class » after stage (r—I) who arc moved to class j by the screening at 
stage r, and i. j — I. 2. 3. .... C ; 

(ii) £ p r (i,j) = i; 

•-1 

(iii) - PrOJ) — 1; 

J-i 

(tv) PrO'. j) - 0 if 

A more general specification of regrad'd screening will be mathematically and 
computationally even less tractable. Initially the entities are divided into C classes, 
in the light of any provisional assessment of their qualities. Thereafter, regrading 
takes placo at each of k stages in succession, this employing only the same categories. 
As above, a CxC matrix. P„ will specify the proportions regraded at stago r, but 
condition (iv) is now omitted. The formal likeness to the transition matrix of a Markov 
process seems unlikely to be of much importance : thero is no reason why the P r 
should be equal, interest will usually lie in small values of k so that no questions of 
approach to a steady stato arise, and the emphasis is on optimal numerical values of 
the elemonts of P, rather than on probabilistic properties of specified matrices. 

Obviously still more general screening processes can be defined by combination 
of the polytomous and regrading operations. Moreover, for any screening, there 
may be constraints that the proportions of the whole population in each final category 
shall be fixed and possibly also constraints on proportions at intermediate stages. 
Whatever the form of the process, the main statistical problem is to seok an optimal 
allocation into final categories by suitable choice of the P r subject to any relevant 
conditions. For the screening of chemical compounds and like entities, only the one 
category is finally retained and therefore any criterion of optimality concerns its 
properties alone. For the school-children, even to decide upon a criterion is difficult : 
all categories are important, but relative values for alternative allocations (Section 7 ) 
cannot readily be stated. 

5. Cohorts 

Some entities present themselves for consideration in cohorts. Children 
aro almost inevitably introduced into a school in one-year groups; although a few 
individuals may be displaced from their own age-cohorts, the screening will essentially 
consist of a sequence of stages applied in the same way to each cohort. New varieties 
of a crop, having survived preliminary screening for disease resistance and other 
characters, will come to the first stage of selection for yield in annual cohorts, and 
will be kept together in cohorts throughout the screening process. 
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On the other hand, there is no particular reason for chemical compounds to 
come for screening in cohorts; they may be sent individually as they are synthesized, 
or a proposal to screen for a new form of biological activity may apply to a large accu¬ 
mulation of compounds, although an artificial organization into cohorts of fixed size 
is sometimes adopted. If entities are grouped in cohorts, specification of the scree¬ 
ning in terms of the fractions to be allocated to different classes at any stage is conve¬ 
nient, in that it preserves an equilibrium state; if there are no cohorts, specification 
of the screening in terras of absolute values of scores that bound the classes may be 
preferred (Section 6). 


6. Criterion* and scores 

The simpler screening processes are those that end with only two classes : 
chemical compounds are or are not selected for further trials, prospective students 
are or are not admitted to a university. As compared with an underlying ideal or 
perfect allocation, errors of two kinds are committed (a familiar statistical pattorn): 
good compounds are erroneously rejected, and poor compounds are erroneously selected. 
More generally, if there arc C final classes, thcro are C(C— 1) kinds of wrong allocation. 

In order to be able to discuss these errors, one must first have a specification 
of the perfect allocation. Each entity may be supposed to have a value for a variate 
x, the criterion ; x is unknown at the time of the screening process although it may bo 
determinable (exactly or approximately) later. Then there will exist a correspondence 
between intervals of x and the class in which an entity ought to be placed, hereafter 
termed the correct class. Usually (though not necessarily) this will amount to hior- 
archic ordering of the classes : the whole range of possible values of x is divided into 
C mutually exclusive intervals, so that any x in the lowest interval belongs to class 
1 , any x in the next lowest interval to class 2, and so on. A more general possibility 
(Section 15) is that the criterion is multivariate, consisting of values of x„ x a , ...,x t , 
so that specification of perfect allocation is equivalent to a partitioning of the 
/-dimensional x-space into regions for the C classes. For entities of the first type des¬ 
cribed in Section 2, to which attention is now restricted, x remains constant through¬ 
out the screening. 

The need for the screening process arises because allocation into classes must 
be made before x is known. At stage r, tests are applied either to all entities or to all 
that still appear to be of interest. The results of the tests are summarized in a score, 
y r , which is expected to be correlated with x. The simple situation is that in which 
\ Jr is the measured performance of the entity under standard conditions, say the mean 
therapeutic response observed in a group of subjects or the mean yield of a variety of 
wheat in a field experiment. If several distinct measurements on each entity have been 
made, they will need to be compounded in order to produce a y r that is an optimal 
predictor of x (say a regression function); this question will not be discussed here, 
ami y t will be assumed determined by external considerations. 

The operation of the screening process will consist of a sequence of k decisions; 
the decision at stage r for any entity, which consists in allocation between the alter- 
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native classes then available, will be based upon the value of y r regarded as a predictor 
of x. It is also possible to make use of scores from previous stages in order to improve 
the quality of the decisions at stage r, though this can present administrative diffi- 
culties. Any optimal procedure might be mathematically complex; one method would 
be to define y r as an arbitrary but reasonable combination of measurements newly 
made at stage r and of those made at earlier stages into a single index. In his pioneer¬ 
ing paper on selection. Cochran (1951) pointed out that the regression function oi x 

on y lt y 2 . y r will be optimal for the selection at stage r, irrespective of selections 

made at previous stages and based solely on the scores then available; Curnow (1901) 
has illustrated the rather small advantages that may accrue from using at stage r 
scores already employed at previous stages in addition to y,. One of tho practical 
conveniences of polytomons screening with discarding of the lowest class at each stage 
is that the number of entities to be tested steadily decreases, so that relatively more 
attention can be given to the testing of each survivor at later stages and the correlation 
of y t with x improves with increasing r. The simplest case is that described for 
chemical compounds in Section 2. Even if tho P, arc of the order of 0.5, the reduction 
in tho number of surviving compounds is rapid and the replication of testing can 
incrcaso correspondingly with consequent advantage to the precision of tho //,; in 
practice, very much smaller values of P, may be used in 3-stage screening. This effect 
may reduce substantially the importance of y,_ x and earlier scores in tho selection at 
stago r. For regraded screening, the position may bo different. 

If a particular score, y, is to be used in allocating entities to different classes, 
thero being a unique ordering of the classes so that the higher the value of y tho higher 
the classes for which it is suited, cither of two methods of specifying the entities for 
a class might be used. One is to place in a particular class all values of y between two 
appropriately chosen limits; the other is to arrange all values ofy in order from highest 
to lowest and place a specified fraction in the class. For example, class 2 might receive 
all entities for which 90 < y < 120, or it might receive all those in tho top 50% but 
not in the top 20%. The first maintains fixed standards for the same classes from 
cohort to cohort; the second is often administratively more convenient because classes 
remain the same size for successive cohorts. If fixed external requirements limit 
the standards of activity necessary in a class of chemical compounds, tho first method 
might be appropriate, but in the screening of school-children the practical limitations 
may be that classes must remain about the same size from year to year. Moreover, tho 
second method raeots tho difficulty of maintaining objective standards from year to 
year: if the cohort is large, it may be assumed fairly stable in distribution so that divi¬ 
sion in the same proportions will ensure reasonable constancy of standards. When 
the number of entities is large, tho two methods become effectively the same. Curnow 
(1959) has remarked on the fact that the expectation of tho mean of tho highest frac¬ 
tion P of values in a sample from normal population rapidly approaches tho mean of 
this fraction of tho population as the size of sample increases. In any practical situa¬ 
tion, minor adjustments in order to be fair to, or to give every possible chance to 
bordorline cases will usually be possible. For the present purpose, the two methods 
of specification scarcely need be distinguished. 
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7. Gains and losses 

In assessing the results of a screening process, often (though not always) account 
need be taken only of the elasses in which entities are finally placed. If after stage k 
there are C final classes, a complete description is contained in the operating charac¬ 
teristic, a column vector x. "here 

X (x) a X = (*«(*)) (*' = 1. 2. C), ... (7.1) 

and x* (•»■) >« the probability that an entity whose criterion value is x is finally placed 
in class i. Clearly, 

X'-l c ••• < 7 -2) 

where l c is a vector of C elements all unity. Perfect screening would be represented 

{ 1 if i is the correct class for x, 

> ... (7.3) 

0 otherwise; J 

this requires that, in the commonest case of an hierarchic ordering of classes, each 
,Y ( (x) is a step function rising from 0 to 1 at the lower limit of the class and falling to 
0 again at the upper limit. In practice, experimental errors will ensure that, oven 
in a good screening process, near the boundary between classes i and (t + l)> xA x ) 
declines and ,y,+,(x) increases steadily (usually continuously). 

Any comparison between alternative processes must depend largely upon 
X* For the present, costs are not being considered. Therefore one process will bo 
superior to another if for every x each \i( x ) for the first is nearer to tho value specified 
in (7.3) than it is for the second. However, this rule permits only a partial ordering 
of alternatives and in practice is quite inadequate ns a basis for choice. It may bo 
possible to specify a v£fctor w, where 

tc(x) ca w = {u\(x)) ... (7.4) 

and u> t (x) is a numerical measure of the benefit that accrues from placing in class i 
an entity whose criterion value is x. Evidently, if * is the correct class for x. 

w t {x) > i o t (x) for all j i, 

but no other condition need bo imposed on w. The most important features of tho 
operating characteristic will then be contained in the function Cl (*), the expected bonofit 
for an entity of value x : 

Q(ar) = Q = x'' w - ••• 

If two processes are such that, for every x. Cl (x) for the first is greater than it is for tho 
second, the first is superior. This rule also will lead only to a partial ordering of alter¬ 
natives, and a choice is likely to have to be made largely on the behaviour of one para¬ 
meter of the distribution of Cl in the population of x. A reasonable rule may be to 
rank alternative processes according to the magnitudes of 

E(C1), 

where the expectation implies integration of Cl over the whole distribution of x in 
tho initial unscreened population. 
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One particularly simple and important form of w has 

is the correct class for x, 

otherwise. 


= 


r 1 if i 

1 0 oth 


} 


(7.6) 


For it. E(Q) is the expected proportion of correct allocations. A slightly more general 
formulation would allow for correct allocation being more desirable in some classes 
than in others, by having 


wAx) 


{ 


w lt independent of x, if i is the correct class for x. 


0 otherwise. 


| ... (7.7) 


Although the simple interpretations of (7.6) and (7.7) may make them attrac¬ 
tive, for many purposes they are far from ideal representations of reality. For example, 
if C — 2 and the correct classes are defined by -oo < * < A', X < * < co respectively, 
in most uses of screening the placing of an entity in tho wrong class will be less harmful 
if \x-X\ is small than if it is large. Often, indeed, a more reasonable form of w 
will bo 


id = 



(7.8) 


at least as ai first approximation. For this io, if rr t ait: the proportions in classes l, 
2 (so that rr x | n t 1), and E x (x), E t (x) are the expected values of x for entities allo¬ 
cated to classes 1, 2 respectively, it follows that 


A*(ii) - A(n l -/r a )--7r l £ l (x)+/r 2 £ a (x). 


(7.9) 


Since n x E x (x) +n t BM = E(x), ... (7.10) 

tho mean for the whole imputation, for fixed w,. n 2 maximization of A’(O) will lx: equi¬ 
valent to maximization of t he expectation of a: in class 2 or minimization of its expec¬ 
tation in class 1. This docs not easily generalize to C > 2. 

Alternatively with C — 2 , w might involve using other functions of x—A\ 
or perhaps a form that assesses the proportion of allocations that arc very clearly 
within the correct classes : 


*»<*> - 1 if * < < A', • 

= 1 if X > A, > A. - 

u*, (x) = 0 otherwise. 


(7.11) 


Other analytically still less tractable forms could easily be suggested ! An approach 
that might appeal to some would be to maximize the probability that all entities arc 
finally in the correct classes. However, if tho number of entities is at all large, this 
probability will almost certainly be so small even at its maximum that discussion 
of it has little relevance to the properties of a particular allocation. 

11 
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8. Costs 

If the sole consideration were that of obtaining the best possible results from 
screening without thought of cost, maximization of 2£(Q) or some similar condition 
would be appropriate. More usually, costs must be taken into account, perhaps 
by seeking an optimal screening subject to a limit on the total cost. In its most 
general form the total cost will be a function of the numbers in the classes at the various 
stages. The primary component of cost is likely to be the expense of making the 
measurements required at each stage. 

The simplest type of dichotomous screening (Section 3) illustrates the point 
well. If at each stage some of the surviving entities are discarded and a proportion 
passed forward to the next stage, the number of entities contributing to costs steadily 
declines. The expected cost per entity may bo expressed as 

A =* a l -{-P l a 2 -\-(P l P 2 )a 2 -{-...+(P l P 2 ... P ... (8.1) 

where a, is the cost per entity measured at stage r. In some circumstances, the a, 
may be all equal. However, the steady reduction in the coefficient of a, as r increases 
may justify increased replication or other improvements in the precision of measure¬ 
ment, which would almost certainly cause a , itself to increase with r. The economic 
problem is to plan for a maximum of E(Q) conditional upon A being fixed, by choice 
of the P t subject to (3.1). On the other hand, for regraded screening, if the class 
sizes arc to be held constant, a cost per entity which is simply a sum of k components 
for the classes in which the entity is successively placed will have an expectation 
independent of the matrices P r . Consequently the absolute maximum of E{Cl) can 
be sought without fear of affecting the costs. 

When variation in initial and final class sizes is permitted, the complexity 
is increased because of the additional parameters with respect to which maximization 
should be achieved. With simple dichotomous screening of annual cohorts, for example, 
one may consider varying rr in two ways. Write «V for the size of each cohort before 
screening begins and n for the number that finally passes the screen; then 

7 T = n/N ... (8-2) 

and optimal values of both .V and « may be sought. If the entities are cereal varieties, 
marginal changes in the amount of plant breeding undertaken might enable .V to bo 
varied substantially. The output from a screening process might be required to con¬ 
sist of n entities, or might be valued as the total of the criteria for the selected entities 
irrespective of their number, that is to say as nE(Q), or might be valued simply as 

These aspects of the economic planning of screening can be discussed quanti¬ 
tatively only in relation to the costs of production of entities and the manner in which 
the results of the process are to be used. A broad distinction may be drawn (Finney, 
1958 . i960) between tin- internal and the external economy of a screening process, 
between planning for optimal screening subject to restrictions on total costs, initial, 
ami (hull numbers, and planning for optimal net benefit from the process without 
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rigid external constraints. Any discussion of the external economy of the screening 
of plant varieties must be concerned with the optimal size of the whole undertaking; 
in its simplest form, the aim would be to maximize 

E(Cl)-A 

while permitting any variations in n and the P,. subject only to (3.1) and such changes 
in the a r as may be consequent upon the P r . 


9. A SIMPLE DRUG SCREENING PROCESS 
Davies (1938) discussed a simple model of a drug screening process that illus¬ 
trates well some of the points from earlier sections. He noted that, when chemical 
compounds are screened in respect of a particular biological activity, almost all com¬ 
pounds show no activity but a few have sufficient activity to be interesting. He 
therefore proposed a binomially distributed criterion as an approximation : x = 0 
for an inactive compound and x — I for an active compound, and the proportion of 
actives is 8, a small quantity. Tests on a standard laboratory animal at any stage 
lead to a score normally distributed about x with variancecr*/«i, where m is the number 
of animals used. Davies considered a two-stage dichotomous process, in which all 
compounds with scores 

yi < Yx - (o.i) 

at the first stage arc- rejected. After the second stage, an average score is used and 
compounds are rejected if 


( 0 - 2 ) 


mjyj+m&t < y 
mj+m, *' 

where w,, m, arc the numbers of animals at the two stages and Y t are to be ad¬ 
justed to agree with specified P x , P t . Compounds not rejected at either stage are 
classed as active (pending further tests), and all others are classed as inactive and 
discarded. Evidently there are simply two types of error : a compound with x = 0 

- I 4 » I (.1 . • • . . .... 


may be classed as active, and one with 
operating characteristic has only two values : 


x = I may be classed ns negative. The 


X = 


(v-) 


at x = 0 


at x = I 


where necessarily (l-W-*i)+<$X, = *- 

If univariate and bivariate normal integrals are defined as 


CO 

wr\= ( 


V2n 


exp (-*«*)</*/, 


(9.3) 


(9.4) 


(0.5) 


CO CO 

L[U " = [ t l ? “ p K-ap^+a!)] du t 
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then reference to (9.1), (9.2) readily establishes that 

V- * [ a ‘ (iS=J 'J ■ 

A simple but reasonable form for w is : 

«M*) = o 


... (9.7) 

... (9.8) 


w t (x) = 


r o if * = 

l 1 if * = 


} 


(9.9) 


or, in words, unit benefit accrues for every active compound correctly placed in class 
2 , but the potential supply of active compounds is assumed so good that no severe 
penalty is placed on wrong rejection of one. From (7.5), 


f 0 if r - 0, "I 

Q(*) = < ... (9-10) 

l X* if * - 1 J 

and E(Cl)=*6 X ,. - (° u ) 

Thus maximizing E(£l) is equivalent to maximizing the probability that an activo 
compound is correctly placed in class 2 , and also to maximizing the mean value of x 
in class 2 which is simple SxJrr. 

If differential costs of screening are proportional to the number of animals 
used, the expected cost per compound, equation (8.1), takes the form 

A = o(m 1 +P,m,)+6 ... (° 12 ) 

where ft, b are constants. With certain numerical assumptions about costs, and with 
n = 0.0!, Davies studied the maximization of E( Q) for fixed A in the limit for small 
S. He showed how the computations can be based upon the bivariate normal integral. 
He also showed that a sequential process applied to each compound, allowing oppor¬ 
tunity for rejection after each animal used, would be formally more efficient, but so 
much less convenient practically that probably the obvious 3-stage analogue of the 
2 -stage process described above would be a preferable alternative. 

Evidently this process could be designed to fit specifications of the operating 
characteristic instead of specifications of P x , P.; if Xt. X* specified, (9.0 and (9.8) 
enable Y, and Y 2 (and hence P x . P t ) to be determined for any particular m 2 . 

An extension of Davies’s model so as to allow * to vary over the three values 
0 , 1, 2 . with exceedingly small frequency for the very active class * = 2, may be worth 
study. 
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10. More oexkral aspects of druo screenin'** 

Interest in screening processes for drugs has been steadily increasing, and many 
papers have followed Davies’s. Dunnett’s contributions seem particularly relevant 
to the present approach. In one paper (1060) he developed important general mathe¬ 
matical results on the consequences of selection from continuous distributions. In 
a second (1961a), he turned more specifically to drug screening, with an extensive 
(and in some respects controversial) discussion of alternative ways of defining an optimal 
screening in relation to a cost structure. 

Later papers (1961b; Dunnett and Lamm, 1062) have been concerned with 
the performance of certain processes. Like Davies, Dunnett has concentrated on 
dichotomous screening with two final classes: necessarily 

Xi(*)+X«(*)~ 1. - < 101 > 


so that the operating characteristic is completely determined by Xzl*)- Howover, 
Dunnett has not restricted himself to a binomial distribution for his criterion. Being 
reluctant to postulate a distributional form for x, he has contented himself with examin¬ 
ing operating characteristics and related properties. Ho is therefore unablo to specify 
a process in terms of the P r . Instead, he determines a process to agree with two 
arbitrary points on the operating characteristic; he chooses x 0 ami .r, (r 0 < .«•,), and 
specifics 


Xt(*o) « XiO' 
* Xtv 


( 10 . 2 ) 


Dunnett considered 2-stnge and 3-stage processes of the same type ns Davies’s 
but mentioned lhe generalization of permitting a final allocation to class 2 ("accep¬ 
tance”) as well as to class I ("rejection”) at all stages instead of only at stage k. Look¬ 
ing particularly at processes in which the number of animals per drug is the same at 
each stage, he obtained rules for the various acceptance and rejection limits on //,, 
(f/i+y*)/2. and ('/i + .Vs+'/a)/ 3 - He could then compare alternatives in terms of the 
expected number of subjects required for reaching a decision on a compound with 
*• = .r 0 . 


On the assumption that y r is normally distributed, but without needing to 
specify any distribution for x, Dunnett has examined this expected number in rela¬ 
tion to x 0 , *, and the standard deviation of the y r \ he also considered the consequencos 
of using fewer or more stages. He recognized the disadvantage of his approach, 
in that (x 0 , Xv>)> (*i» the points specified on his operating characteristic, are entirely 
arbitrary. Implicit assumptions are that the two correct classes will be defined by 
x < X and x > X, and that 


x 0 <X < x l . ... (io.3) 

Ho suggested several alternative functions whose maximization would provide a 
reasonable rule for determining an optimal process, including those proposed by Davies 



D. J. FINNEY 


86 

and some new ones. All necessitate integration or averaging over the distribution 
of r. in order to give the proportion of compounds correctly classified, the mean number 
ol animals needed for compounds of all degrees of activity, or some similar quantity. 

In his second paper (1961a). Dunnett turned to the problem of formulating 
a screening process that is optimal under the conditions of a particular coat structure. 
He restricted himself to a binomial distribution of r. He discussed a system of gains 
formally equivalent to the »r of equation (7.7) and, as in Section 8, a total cost pro¬ 
portional to the mean number of subjects per compounds. He distinguished two 
situations : 


(i) The number of compounds is unlimited but testing facilities (e.g. number 
of animals or total time) are limited. Maximization of E(Q) conditional on the 
limited facilities is required. 

(ii) The number of compounds is fixed, but facilities are unlimited except 
by the aim of securing a large net gain from screening. Now K{Cl) — A requires to bo 
maximized. 


He recognized the difficulty of giving meaningful numerical values to the elements 
of w(.r), and especially of measuring on one scale the gain from correct classification 
of an active compound and the loss consequent upon wrongly rejecting it; nevortheloss, 
any choice of process specifications contains some implicit choice of values and nothing 
is gained by refusal to make explicit the difficulty. He concluded with outlines of 
computational procedures for finding optimal I, 2, and 3-stage processes when his 
approach to costs replaces Davies’s. 


More recently (1962). Dunnett and Lamm have provided charts from which 
can be read the numerical specifications for this type of screening with k = 2, 3, or 
4 and for constructing the operating characteristics. They have also discussed wisely 
the manner in which an investigator should determine his initial arbitrary choices in 
the light of knowledge and experience. Nevertheless, whether a fixing of two points 
On the operating characteristic is an adequate restriction on the choice of a process 
may be open to doubt; operating characteristics for a different problem discussed later 
(Section 12) show very different behaviours at intermediate points oven when rather 
similar at extremes. 


Among other interesting recent contributions to 
King (1962). J'\>r a 1-stage screening process essentially 

compared a binomial distribution of x with an exponential 


the subject is a paper by 
the same as Dun nett’s, ho 


he-^dx 


and found good agreement between both the optimal specifications and the outcomes. 
King commented on the general problem of establishing efficient screening processes, 
saying that the “method of approach emphasizes its own shortcomings by pointing 
out the need for a solution to a much broader strategic problem, the optimum alloca¬ 
tion of available resources among different research programmes. It is comparatively 
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simple to quantify existing facility restrictions, but difficult indeed to determine what 
these restrictions ought to be. For example, screening systems for several different 
types of chemotherapeutic activity may be carried on simultaneously using the same 
facilities, equipment, and staff. The search for the optimum proportion of these re¬ 
sources that any one system should utilize quickly encompasses the total research 
effort of the organization.” Later, and more succinctly, he said "the problem of 
attaching a numerical value to the discovery of a cure for a disease is exceedingly nasty.” 


11. Screening ok crop varieties 

One of the most easily appreciated of screening problems is that encountered 
by a plant breeder whose routine operations make available a large cohort of potential 
new varieties each year. He may wish to reduce his annual cohort to a fraction 
n of itself during A- successive years, in accordance with equation (3.1). Although traits 
other than yield will need to be taken into account, 1 assume that wo are discussing 
cohorts from which varieties with high disease susceptibility and similar undesirable 
features have already been eliminated, so that in the present discussion attention 
can be concentrated on the yield of marketable produce per unit area. 

The screening is dichotomous, as for the chemical compounds, varieties placed 
in the lower class at any stage being regarded as valueless and discarded. Again 
there are only two final classes, the discarded and the selected, although the latter may 
have to undergo further tests before any are adopted for commercial farming. Screening 
would be judged completely successful if the Hnal class 2 consisted of the lop fraction 
n oi t he distribution of x, but the gain obtainable from any new variety will be approxi¬ 
mated by a multiple of x, say 



w -\r)‘ 

... ( 11 . 1 ) 

Hence 

n (x) - cx Xi {x ) 

... (11.2) 

and 

E{Cl) = cn t E^x). 

... (11.3) 


In any one year, the plant breeder has trials to conduct on the (b-l) sots of 
survivors from cohorts that began their screening during the previous (fc- 1 ) years 
as well as the trial for stage I on the newest cohort. In discussing this elsewhere 
(Finney, 1958), with the aid of general mathematical theory on the effects of selection 
on the moments of a distribution (Finney. 1956, 1961), I assumed his total experimental 
area per annum to be limited, so that increased precision of experimentation on one 
cohort can be bought only by reducing the share of the area allotted to othcre If the 
initial number of variet ies is about the same for all cohorts, a reasonable approximation 
is to take the error variance of a varietal mean at stage r to be proportional to the 
product P, J>,-, (i.e. to the number of survivors of the cohort that must be tested 
at stage r), and inversely proportional to the area allotted to this cohort at stage r 
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Although no analytical solution to the problem of optimal screening is likely 
to be obtainable, numerical investigations have been undertaken for several reasonably 
realistic situations. For example, under the assumption that x is normally distributed, 
I examined (1958) the case of 2-stage screening with v = 0.01. The maximum of E{Q) 
occurred very close to l\ = 0 . 1 , with half the total area used at each stage, so that at 
the second stage each surviving variety has 10 times the experimental area that it 
had at the first. Supplementary calculations suggested (but certainly did not prove) 
that, for a wide range of situations, the optimal conditions for 2 -stagc screening would 
be well approximated by 

Pi = Pt 

and an area for each surviving variety at the second stage 1/P t times that for each at 
the first stage. For particular numerical values of variances chosen as realistic for 
cereal breeding, E(C1) was almost 90% of the value it would attain if screening were 
perfect. I surmised that for k > 2 the obvious generalization 

P x = P t = P 3 = ... = P k 


and areas for each surviving variety in the ratios 

P x P t P 3 ... P k . x : P t P 3 ... P k -i : P* - Pt -» : ••• : 1 
would be near the optimal. The assumed inverse proportion of variances to areas is 
probably too extreme, and improvement of it might favour allotment of slightly larger 
areas to early stages. If n is very small, random discarding of a substantial fraction 
of a cohort before the first stage of trials may increase the expectation of gain, since 
it permits more intensive testing of the varieties that are retained (but sec Section 12) : 
for any fixed n, this possibility rapidly declines in importance as the number of stages 
is increased. 

Curnow (1961) lias looked at other cases of 2-stage screening when x is normally 
distributed and also when x has a beta distribution ; although the actual magnitude ol 
E(Q) changed, the symmetric scheme in respect of the P, and the areas was consis on y 
close to the optimal. He went on to consider 3-stage selection with x normal and 
n = 0 . 001 , and again found the symmetric scheme to be nearly optima . 


Curnow also took further my attempt (1960) to study the external economy 
of a varietal screening process, and summarized numerical results for 1-stagc and ^-s-ge 
screening. The particular results are of limited interest, but the method “ 
as demonstrating the practicability of asking and answering questions™« 
many entities is it desirable to produce or collect for screening 1 and What to al 

sum should be spent on operating a screening pioccss . y should be 

fits that accrue to the whole economy. The question “How many *^* '7*1 a 
used ! ' is of special im,iortai.ee in the screening of crop vanet.es; each stage adds at 

Davies s conclusions in an entirely different context. 
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It is no part of my purpose here to decry the value of classical methods ol 
statistical analysis for crop variety trials, or for comparisons between drugs, in terms 
of analysis of variance and significance tests. In any fundamental study of the in¬ 
trinsic properties of these entities, these are essential. Often, however, varieties or 
chemical compounds are of interest only in so far as they seem likely to be improve¬ 
ments on their predecessors. .Significance tests then cease to be relevant, and thoguiding 
principle is simply : 'In the light of evidence available at this moment, is the expee- 
tat ion of gain greatest if we accept the entity under discussion, if we subject it to further 
trial, or if we discard it and divert our efforts to trying another ?” Questions such as 
this cannot be answered unless we have more quantitative information on the conse¬ 
quences of various right and wrong decisions than is usually available to-day, but. 
we may hope that direction of attention to the problem will encourage flic develop¬ 
ment. of better asses incnts of the elements of *c{x). 


12. Opkkatino characteristics hok variktal SELECTION 


Although the screening conditions that maximize E(il) for the varietal selec¬ 
tion model can be obtained numerically, as described in Section II. it soon becomes 
evident that the response surface is very flat near its maximum, in the sense that quite 
huge changes in the P, have little effect, on E(Q). especially if they are compensated 
by changes in the proportion of the total area allotted t » the different stages. In an 
attempt to study further the nature of any differences between processes that are 
similar in their values of E(Cl), a few operating characteristics have been calculated 
for 1-stage and 2-stage screening. 


The particular model used is that for which x is normally distributed with 
mean 0 and variance 1 and in which n - 0.01. One generalization, mentioned in 
Section 11, has been incorporated, this allowing for the possibility of discarding part 
of each cohort without any test and reducing the size of the cohort by a fraction P u in 
order to allow more intensive testing of the remaining varieties. Thus for I-stage 
screening 

” = p * l \ ... (12.1) 
and for 2-stage screening jt P 0 P t P 2 . (12.2) 

As has been shown (Finney. 1958). this can lead to appreciable increase in tf(i2) foi¬ 
l-stage but is less helpful for 2-stage screening ; for the present study only P„ * I 
is used in 2-stage screening. In accordance with the approximation stated in Section 
11 , the observed mean yield of a variety will be assumed normally distributed about 
the population value, x, with a variance 


^~~y p o ... (12.3) 

for l -stage and 6? = yPJa ( , 2 4) 

‘f-y/V*,/(!-«) ... (l2 .5) 

for the first and second stages of 2-stage screening ; here y is a constant and a is the 
proportion of the available area that is allotted to the first stage. 
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The basic ideas on the operating characteristic have been stated by Sichel 
(1952). Davies, and Dunnett. Here they take a very simple form because the nature 
of the model ensures that amongst varieties with a common a: the observed y x and y 2 
are uncorrelated. For a whole cohort. y x and y 2 are normally distributed with means 
zero, variances 

<*>? = 1+e? 

<*>’£ = 1+ef J 

and correlation coefficient 

p = 1/o^to,. 

If VV 2 are the solutions of 

L[U t ) = P x 
L[U x , l U t ;p]^P l P tt 

then the cut-ofl points for the selections are U x o> x and U 2 o> 2 , of which only the first 
is used in 1-stage selection. With this notation, the probability that a variety with 
true value x survives the screening and is placed in class 2 is 

for 1 -stage and 

for 2-stuge screening. Although these formulae have hero been developed with re¬ 
ference to a normal distribution of x. if U x o>, and U 2 oi t are replaced by arbitrary 
cut-off points and «f, are replaced by arbitrary error variances they become 
perfectly general. 

1 have for the present restricted calculation to y = 1. For 1-stage screen¬ 
ing of intensity ff a 0.01, the obvious procedure is to take P 0 = 1. P t = 0.01. 
However, this leads to 

E{Ll) = 1.885 

whereas, by taking J' n — 0.4531, P x = 0.02207, a value 

E(Cl) = 1.978 

can be attained (equations 18, 19. Finney, 1958). Figure 1 shows the two operating 
characteristics, together with that for the symmetrical 2-stage screening which has 

P 0 = \,P X = P t = 0.1, « = 05 

E(Cl) = 2 - 345 . 


Xtix) = P^L 


( 


... (12.9) 


( 12 . 10 ) 


... (12.0) 

... (12.7) 

... (12.8) 


and for whirl* 
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Perfect screening, giving the fraction rt.OI of the highest values of x, would select all 
varieties with x exceeding 2.326, and would have 

FHCl) = 2.665 



Fijpir© I. Op©mtinfr r| ( Anicl©ri«ti«-» for v«notal -olrriion with T = C.“l 

- I .-tag©. Pm — I.U, P, m 0.01 

. I•atage./> 9 - 0.4531. P, - 0.02207 

■■ 2-Mage. Pa — 1.0. Pi ■»/**« 0.1, « — 0.5 
TIi© or row jn«rk« x - 2.326.1 lie l>oundnry Irotweon I ho rorrccl Ha**©*. 

If one could say with certainty that attention should he concentrated on 
maximizing E(Cl), then the second 1-stage process is superior to the first by about 5 
percent. However. Figure 1 makes clear the nature of this superiority. It is achieved 
by selecting an appreciably higher proportion of entities in the range 1.8 < x < 2.8 
but a very much lower proportion of those with x > 3.5. Even with the first 
process, only 60 percent of entities with x — 3.5 will he selected, and this drops below 
43 percent for the second process. An investigator who, despite his wish to have a 
large E(Cl), was especially anxious not to miss the rare occurrence of an exceedingly 
good variety, could reasonably regard the loss on P(fl) as a small price to pay for the 
better performance of the first process (P 0 = 1) at high x. In plant breeding, at least 
with the better known crops, perhaps sudden remarkable gains arc too unlikely for a 
strategy aimed at them to be desirable; in an analogous problem in the screening of 
chemical compounds, say for therapeutic or herbicidal activity, the element of gamb¬ 
ling involved in a strategy that aims high may be justified by the potential rewards. 

Inspection of Figure 1 indicates a general superiority of the 2-stage process, 
a steeper rise in the neighbourhood of x = 2.326 and a closer approximation to the ideal 
step-function. It is perhaps worth noting that the 2-stage and 1-stage (P 0 — 1) 
curves intersect again at about x = 5.9, after which the 1-stage is the better, but 
as 99.5 percent of varieties arc then being selected by either this is scarcely of practical 
importance. 

In Figure 2, the 2-stage operating characteristic has been re-drawn together 
with those for alternative 2-stage processes, both with P 0 = 1. The first has P, = 0.4, 
a = 0.2 and 

E(Cl) = 2.166; 

the second has P x = 0.025, a = 0.8, and 

E(Q) = 2.245, 
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Neither is very markedly poorer than the symmetric process in respect of E(Cl), 
but both appear inferior in operating characteristics, especially near x = 3.0. In the 
formation of E(Q). the considerably poorer chance that one of the rare varieties in 
the range 2.4 < .»• < 3.0 will survive the screening is almost compensated by the 
greater chance for the much commoner varieties with 1.5 < x < 2.0, but if the dis¬ 
covery of large values of x is important the advantage for the. symmetric process is 
clear. Once again, there is a surprising reversal at still higher values; near x = 5.7, 
the curve for P x = 0.025 crosses that for P, =0.1. and that for P, = 0.4 is the highest 
of the three in the neighbourhood of x = 4.2. but Q(x) is so laigc for all three that 
the differences scarcely matter. Although further study is certainly needed, the evi¬ 
dence strengthens the view that P, = P t = tt», ct «* 0.5 is a good practical rule for 
2-stage screening of the present type. 



Figure 2. Operating el.eracterii.tira for 2-»t«g© variotal -eloct.on %rifli n - 0.1. / o - M> 

-/*,-/>,- o.l. a - «.5 

. P, - 0.4, Pt - 0.025. « - 0.2 

_/». — 0.025. P t - 0.4. « — 0.8 

The arrow mark* x - 2.320. the boundary botwoon the correct clnraoe. 


Figures 3 and 4 show the frequency d 
whose operating characteristics are presented 


listributions of x for the five processes 
in Figures 1 and 2. 



50 40 

Figure 3. Fiequency distribution* "f * "ft®* 
varietal selection will, at 0.01 

_I .stage. Pm - l.». Pi 0.01 

.I .atHire. /’» - <>.4531. /', 0.0220. 

__2-stsgO.Po !•«». Pt 

Tl.o arrow marks * - 2.320. tho hmindary 
botwoen tlio correct .losses. 


Figure 4. Frequency distributions of.* after 2-stOKO 
varietal selection with v - 0 . 01 . / o - 

_ P . = P 7 — 0.1. a -0.6 

. P, - 0.4. Pi - 0.026. <* - 0.1. 

_ p. =. 0.025. Pi - 0.4. a =0 8 

The arrow marks * - 2.320. t he bow,.dory 
between the correct elesecs. 
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13. Educational screening 

As already remarked, the periodic rearrangements of children within vanous 
streams of a school, in accordance with successive revisions of estimates of their a ».- 
lities, is a form of regraded screening. Further theoretical study of this type of screen¬ 
ing is needed, which should take account of the special features mentioned in -Section 
2 , namely that entities are not to he discarded as valueless because they have been 
placed, temporarily or even permanently, in a low class and also that the value of* 
for an entity may change from stage to stage in accordance with the sequence of 
classes in which it is placed: this complication is here ignored. 

A 2-stage process that is a mixture of dichotomous and regraded screening has 
been studied (Finney, 1062c) as an introduction to the approach likely to be needed 
in any research directed at improving an educational system. Equation (3.1) was 


replaced by 


rr = P l P t +(l-P i)ri 


(13.1) 


and applied to a population in which x is normally distributed. The model is perhaps 
absurdly oversimplified, but may be -egarded as an approximate representation 
of selection for universities. Here x is regarded as a measure of suitability for uni¬ 
versity education, and may without loss of generality be supposed standardized so as 
to have zero mean and unit variance. If X is the normal equivalent deviate corres¬ 
ponding to probability n, then the correct class for an individual is : 


Class 1 if * < A' 
Class 2 if x > X. 


At stage 1. perhaps at age II, a fraction P, is accepted for those secondary schools 
that provide adequate preparation for academic studies and the remaining fraction 
(I— P,) goes to other schools (or to non-academic streams of the same schools). 
At stage 2, six or seven years later, a fraction P 2 of the academic class is select *d for 
the universities and, as a corrective of any major errors at stage 1. a fraction P\ of 
the non-academic class is also selected. At stage r, the selection is based upon a score, 
y,, compounded of examination and test results and any other available assessments. 
y r being assumed to differ from x only because of normally distributed random error. 
If stage 1 has been at all satisfactory. P\ should be much smaller than P 2 . 

Unfortunately, too little is known about the population correlations of 
x > Ji » Hz for much confidence to be placed in any computations: however, calculations 
based on 

p(x, y x ) = 0.70, 

p(*. y t ) = 0.75, 

piyi- y t ) = o.70. 

(thought not to be too unreasonable for British conditions), and n = 0.10 showed 
E(Cl), defined as in equations (11.1 HI 1.3), to be maximized at about 

P, = 0.125, 

P 3 = 0.618, 

PI = 0.026. 


> 


... (13.3) 


... (13.2) 
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11>«‘ optimal rive* a value to £,(., ) about equal to the mean for the highest 21% of 
the^-distribution, which is what would he achieved in simple one-stage selection with 
- 0. | o d a score whose correlation coefficient with * were 0.783 could be used. Thus, 
the results are not very much better than would he selection based on y 2 alone, but 
ot course there are important practical advantages in having also the first stage. As 
Lewis (HM»2) pointed out, the operating characteristic of a process such as this can be 
computed much as was described in Section 12. Unless 

Pi*’ )/>(*, y*)-/>(.V„ y t ) = o, ... (13.4) 

the formula for (?(.r) does not reduce to a function of univariate normal integrals, 
and calculation will be tedious. However, in view of the complications already 
encountered in comparing the qualities of alternative operating characteristics in 
Section 12, the importance of the educational problem would certainly justify through 
numerical investigation as soon as a satisfactory mathematical model and trustworthy 
estimates of intercorrelations are established. 

The findings would be modified if allowance were made for the likelihood 
(as one would hope!) that a child allocated to the upper class as a result of screening 
at stage 1 would thereafter experience an environment more conducive to university 
success. In consequence, both a- and y t would be likely to be increased relative to the 
numerical values that the same child would have had if he had been placed in the lower 
class. The effect presumably would bo to reduce the optimal P\, perhaps to zero, 
and to increase the optimal P x . An analogous 3-stage process could be based on 

* - I PiPt+U-Pi)Pl) + ... (13.0) 

the principle being to allow a second chance to those who are placed in the lower 
class at stage I or stage 2 but not to those who are so placed at both stages. 

I have discussed details fully elsewhere. The weaknesses of the approach— 
neglect of any aim for education other than to skim the cream for the universities, 
inadequate allowance for the effect of education on the child, compression of a very 
complex process into the simplicity of equation (13.1), and doubtless many more—are 
obvious. Nevertheless, I have ventured to suggest that any educational system, 
whether carefully planned or one that “just growed”, has implicit assumptions about 
the optimal proportions that will follow different types of course at different ages. 
It is surely desirable to collect adequate information about the pattern of variation 
and intercorrelation in the population, so that statisticians may formulate and examine 
somewhat more realistic models: conclusions that they reach will not decide the struc¬ 
ture that education ought to have, but should be one important component in the 
planning of future policy. 

Cronbach and Gleser (1957) have made an interesting approach to screening 
tests on human beings that is too different from the processes described above to be 
adequately summarized in this paper. They are particularly concerned with decisions 
on individual placement for different types of employment or training, in situations 
that permit the final decision to be reached fairly rapidly although some form of se¬ 
quential testing may be adopted in order to ensure that marginal cases are examined 
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most carefully. Such a timetable affects greatly such factors as const mints on class 
sizes, changes in individuals between successive stages, and the practicability ol using 
scores front previous stages when screening at stage r. An even more striking feature 
is that Cronbach and Gleser consider regressions of outcome or "payoff" (in tin* sense 
of the benefit that accrues from placing an individual in a particular linal class) on 
scores, without taking any account of sampling errors to which the scores are subject . 
It is difficult to believe that, in their field or any other the score achieved by each 
individual tested can he identified with his inherent ability in the test situation, yet 
surely the latter is the right basis for defining correct classes and assessing payoffs. 
To modify Oon bach's model appropriately would introduce the usual complexities 
of regression with an independent variate subject to error, and would probably destroy 
the simplicity of the theoretical results reported. Nevertheless, so much careful 
thought has gone into Cronbach\s research that it will undoubtedly repay fuller study 
and an attempt to integrate it with other screening theory and practice. 

14. Further mathematical theory 

Educational research workers have long been aware that selection in respect 
of one variate affects means, variances, and correlation coefficients of variates corre¬ 
lated with the first. Probably the earliest formal mathematical discussion of problems 
in this field is to he found in two papers by Karl Pearson (1902, 1912). Although 
Pearson’s theory rested upon assumptions of normality of distribution to u greater 
extent than he recognized, Lawlcy (1943). following Aitken (1934), showed dependence 
upon normality not to be complete. In recent years, many investigators have 
developed the theory of truncated distributions, primarily for purposes of 
estimating parameters of original distributions when the only observations available 
have been truncated or censored. Rather different emphasis is needed for studying 
properties of truncated portions of distributions themselves and thence assessing 
optimal points of truncation for several successive stages, a general description that 
embraces the problems of the present paper. 

In 1950, I obtained general formulae for the first four moments of the distri¬ 
bution of one variate after a truncation in respect of a variate differing from the first 
only by the addition of a normally distributed error, the original distribution of the 
first variate being specified by arbitrary cumulants. Later (1961), I showed a 
further generalization that permitted the two variates originally to have a 
completely arbitrary set of individual and joint cumulants. Regarding the first 
variate as * and the second as y, this theory enables the consequences of any single 
•stage of screening such as I have described in this paper to be followed, at least as 
far as tho first four moments of x; multi-stage screening can then be studied by 
successive applications of the formulae, provided only that all the original cumulants 
can be specified. Unfortunately, not only arc the formulae complicated, but tho 
moments are expressed as infinite series that usually converge slowly and this conver¬ 
gence becomes worse as either the intensity of selection at one stage or the number 

of stages increases. 
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When the original distribution of x and y is bivariate normal, exact results 
are obtainable for the result of one-stage dichotomous screening. The mean and 
variance were found by Pearson, frequently used, and concisely expressed in modern 
notation by Cochran (1950); the general cumulant can be written as a differential 
coefficient of the logarithm of the normal integral (Finney, 1956, 1961); tables for the 
first five of these functions have been Prepared (Lipton. unpublished), and values 
can be computed directly from Table II of Pearson (1931). I have further showed 
the possibility of using a more general "‘selector function which is the operating 
characteristic for the score, y. or the probability that an entity having a particular y 
is put into the upper class; a formal solution is still available for the general cumulant 
of the .r-distribution after screening. Curnow (1960) has shown some exact results 
for one-stage screening of particular non-normal distributions, which are useful in 
tests of robustness of qualitative conclusions based on normality, but attempts to find 
a type of distribution that will give tractable exact formulae for two or more stages 
of screening have not succeeded. 

The most obvious numerical or algebraic approach to a problem of multi-stage 
screening, and the one that 1 have used, is to discuss each stage successively by consi¬ 
dering the new distributions of x generated by the classification at stage r based upon y r 
In his pioneering paper, Cochran (1950) adopted the alternative of examining the whole 
process in relation to a multivariate distribution; Dunnett (loc. eit.), Curnow (1959), 
and others have also used this approach. There exists a (&+1) -variate distribution 
of (*, !/v !/t- The ^-dimensional space of the y r is partitioned by boundaries 

consisting of {k— 1 )-dimensional hypcrplanes at right-angles to the k axes, so ns to 
divide this space into mutually exclusive rectilinear regions of the form 

Ymr < 'Jr < Y $,. (' = 1. *.*>• 

with some intervals open to infinity at the left or right. Each of the final C classes 
consists of one or more of these regions. Any polytomous or regraded screening process 
can be expressed in this fashion by appropriate grouping of all regions into C classes. 
The properties of a process and its optimal specifications can then be discussed as 
before, in terms of the properties of the C parts into which the distribution of x is 
divided. Investigation by reference to this (*+1 )-dimensional space has advantages 
in theory, by permitting many results to be written explicitly in terms of multiple 
integrals; as soon as numerical evaluations are wanted even for normal distributions, 
however, the lack of adequate tables and the intractability of the integrals for more 
than two variates becomes a serious barrier. Curnow and Dunnett (1962) have 
transformed some of these integrals in ways that expedite computation. Various 
writers have recently presented formulae relating to the multivariate truncation of 
multinormal distributions, which would enable moments or cumulants of a: in a class 
to be obtained if multinormality were assumed (Weiler, 1959; Rosenbaum, 1961; Tallis, 
1961; Finney, 1962a). Extensions to a general multivariate distribution are possib o 
(Finney, 1963), but the formulae would involve very laborious computation. 

Federer (1961) has prepared a valuable collection of references. 
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15. Multivariate criteria 

Somewhat different consideration* arise, however, if the criterion is multi¬ 
variate. I shall mention briefly the form of problem that arises in animal breeding 
and selection, with emphasis on I-stage screening. The new step is to take .r as a 
vector of ( elements, representing the true criterion for an animal in respect of its 
genetic constitution: the elements of*, sav x m . might relate to yield of wool and to 
quality traits of the wool for each of several years of a sheep’s life. To each x„ cor¬ 
responds an element of »/. the .r„ value plus components of environmental And other 
random variation. For economy of symbolism. x H . //„ may be supposed to have 
moans zero, so that 


E(x' X) = a ... ( Iff.l ) 

and E(y'H) *••• ( ,r,<2 > 

where o. 10 are nxw variance-covariance matrices: also, if the error components 
of y are independent of r, 

E(y‘ x) — o. ... (1».3) 

In gcneticnl contexts, the ratio is termed the heritability of trait u. In general, 

although each »/„ has a particular logical association with the corresponding .r„. being 
a measurement of the same trait, it will also be correlated with other elements of x. 

Sometimes the aims of screening are adequately expressible solely in terms 
of a single-valued function of the elements of x. The screening process might then 
seem to require no new discussion : the index compounded from the x„ can simply 
replace the old single x. A particular case, often used by geneticists although evidently 
an oversimplification, is that of an index 


X-a*. ... ( 15 . 4 ) 

where a is a vector of coefficients such that a u is the economic value per unit of x H . 
Practical convenience, however, may make alternative rules of selection worth consi¬ 
deration unless they prove to be much les* efficient. 

For example, in animal breeding the screening will usually be dichotomous 
with the lower class discarded and the aim of maximizing E 2 (X). the exi»ectation of 
X in the final upper class. Suppose first that only one stage of screening is contem¬ 
plated. The optimal procedure will be to compound the y u into a single score that 
correlates well with A' and to base allocation on this. This is exactly as described 
in Section 6 for the formation of any y r . and under the assumption of a multivariate 
normal distribution it simply involves formation of the linear regression of X on the 
y„. Animal breeders refer to this as index selection. They contrast it with independent 
r.ulling, a process in which each y m is separately dichotomized : the upper class con¬ 
sists of animals for which 


13 


y u > Y y for all u, 
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the } l( being chosen so as to give the desired proportion in the class. Independent 
culling is evidently formally the same as a multistage dichotomous screening with 
each //„ regarded as the score for a separate stage, although all y„ are available simul¬ 
taneously. Naturally it is less efficient than index selection, in that E 2 (X) is smaller, 
especially if the traits are uncorrelated and of roughly equal importance in the cons¬ 
truction of X. but Young (1061) has found that the loss may not be great. There 
can be practical advantages, both because of simplicity and because animals reason¬ 
ably well balanced in all traits may be preferable to those for which a very high value 
of one trait compensates for indifferent values of others, essentially a recognition that 
(lo.4) is an adequate approximation only in a central region. Young and Weilor 
(1060) have prepared nomograms to assist the maximizing of E 2 (X) by suitable 
choice of the y t for two traits: the formulae of Tallis (1061) and Finney (1062b, 1063) 
are again relevant. 


Animal breeders also employ tandem selection, in which in one generation 
selection is concentrated on one trait, with the intention that in the next generation 
attention shall be switched to another trait. This, however, introduces questions of 
multistage screening once more. Users of tandem selection tend to assume that the 
same formulae can be applied in successive generations, except for the reductions in 
variance and changes (usually also reductions) in correlation that occur; they fail to 
allow for the skewness that must develop even if the original distribution wore multi¬ 
variate normal. Genetic recombination may mitigate the ill-effects of skewness, 
but there will be a tendency to overestimate the gains from selective screening. More¬ 
over conditions particularly favourable to gains from selection (small values for n and 
the P r in equation (3.1), and high heritabilities) are precisely those that rapidly induce 
skewness. The low multiplication rates of farm animals usually prevent intensive 
selection, so that this effect may not become serious for several generations, but un¬ 
critical application of proposals for tandem selection to other fields of screening could 
mislead. 1 


Application of index selection and independent culling to successive stages, 
whether each stage is a year in the life of one generation or each stage is itself a whole 
generation, will obviously complicate the theory immensely unless the accumulated 
effect of selection is so slight as scarcely to modify an initial normality. I shall not 
discuss this further here, for clearly the multistage problem raises all the questions of 
screening encountered in earlier sections together with the new difficulties of balancing 
the importance of different traits. The simple logical point, too often overlooked 
though it ought not to need emphasizing to scientists, is that one cannot maximize 
or optimalize for more than one function at a time: one must choose, at least temporarily, 
a single function as the most reasonable compromise between competing aims. 
However, the maximization can be made conditional on certain constraints, 
such as requiring one or more other functions of the measurements to remain 
constant or to be maintained above specified minima (Kempt home and 
Novdskog. 1 !■'>•)). 
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THE PLACE OF THE DESIGN OF EXPERIMENTS IN THE 
LOGIC OF SCIENTIFIC INFERENCE* 

By RONALD AYLMER FISHER 
1. Early aims 

When, a little more than 25 years ago. I first attempted a systematic exposi¬ 
tion of the subject, known as the Design of Experiments, it is no very grave confession 
to avow that l did not fully understand the position among the statistical seimices 
of this new discipline. My approach at that time was frankly a technological one. 
As a statistician I had often set myself the task of analysing experimental data, and 
was much concerned with those improvements in statistical methods, which promised 
to make such analysis, more thorough and more comprehensive. Technically. I could 
see that some methods were superior to others in the concrete sense of extracting from 
the data more "information" on the subjects under enquiry, and therefore of lending 
to estimates of higher precision, and to tests of significance of greater sensitivity. 
And so it was. in this atmosphere, borne in upon me that very often, when the most 
elaborate statistical refinements possible could increase the precision by only a few 
per cent, yet a different design involving little, or no additional experimental labour, 
might increase the precision two-fold, or five-fold or even more, and could often 
supply information in addition on relevant supplementary questions on which the 
original design was completely uninformative. 

It was thus clear at an early stage that there were quantitatively large techno¬ 
logical gains to be obtained through the deliberate study of Experimental Design, 
and that these gains were to be harvested by making tho plan of experimentation 
and observation logically coherent with tho aims of the experiment, or, in other words 
with the kind of inference about the real world, which it was to be hoped that the 
experimental results would permit. At this point we catch sight of some questions 
concerning the nature of tho inferences which are possiblo from the data of tho Natural 
Scioncos, which scorn still to be matter of dispute, and of which I hope to speak more 
fully at a later stage. 


2. Combinatorial progress 

For the present, it will be familiar to us all that in the numerous books which 
have appeared and are appearing on the Design of Experiments the chief attention 
has been given to developments in combinatorial mathematics often of quite an intri¬ 
cate charact er, which h ave undoubtedly served greatly to enlarge the experimenters 

• This was a Providential address delivered by the late Sir~S o^iTa.~F isher atThol^atkmnl 
Symposium. "I-e Plan d’Experienco", held at Pari, in IMI. and i. reprinted in this volume with tho 
kmd perm,«,on of tho Centre Notion^ de la Recherche Scientifique. This add™, was prepared by 
Sir Ronald dunn« his visit to the Indian Statistical Institute in 1060-6! and it was his desire that the 
address be reproduced in an Indian publication. Editors. 
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repertoire of designs effective in very varied fields of enquiry. Their efflorescence 
has been rapid, and it must have given pleasure to experimenters in many parts of 
the world to learn, as we learnt little more than a year ago. of the success of 
it. C. Bose, and his American and Indian colleagues in settling a problem in pure 
mathematics, which has been a challenge since the time of Euler, by demonstrating 
the existence of Graeco-Latin squares of side 10. and some other numbers of the form 
4r-f 2. Euler had satisfied himself of the non-existence of such squares of side six, 
though he had not enumerated the Latin squares exhaustively, or recognised the 
existence of the twelve types into which they may be classified. Even for the 0x6 
squares his paper left room for doubt, though his conclusion was, in fact, correct. 
He also suggested that the same might be true for all even numbers not divisible by 
four. For my own part I think such a conjectural suggestion, which he never suggested 
he had demonstrated, desirable for the advancement of mathematical thought. Bose's 
discovery seems to do no injury to Euler's reputation, but it is, of course, a decisive 
refutation of several claims made in the twentieth century to have proved the truth 
of Euler’s conjecture, and of even more inclusive theorems, by topological methods. 
The case is not that of a contribution of pure mathematics to experimental design 
so much as a by-product of the intensification of interest in combinatorial mathematics 
due to the modern recognition of their importance in this applied field. It is certainly 
good to have a supposed restriction decisively over some. We must try to find some 
work for these 10 x 10 Graeco-Latin squares. 

3. Scientific experience 

Now, if we arc to encourage the experimental scientist to seek expert advice 
before the experiment is executed, and not merely, ns too often in the past, to call in 
a statistician for the post mortem, I think wo must do a little more than many of the 
writers of these books seem to consider noccssary, and this in two respects. The 
literature ns it has grown up seems to be unbalanced in its comparative neglect of the 
Scientific aspects of the problem, and of its Logical aspects. This perhaps might 
have been expected, since many of the authors, albeit talented mathematicians, have 
evidently never submitted their minds to the specifically educational discipline of any 
one of the Natural Sciences, have never taken personal responsibility for experimenta¬ 
tion at ground level, and have no direct experience of the kind of material involved, 
but only of the reactions of mathematically minded students, exhibiting acuity perhaps 
but without depth of focus. Seminars, discussing and rediscussing questions, whether 
substantial or trivial, but always at this shallow level, taking tune that might have 
been given to laboratory experience, must bear their share of responsibility, for the 
sameness and lack of constructive thought, of the many new books which come onto 
our desks in their glossy covers. 

There is, frankly, no easy substitute for the educational discipline of whole¬ 
time personal responsibility for the planning and conduct of experiments, designed 
for the ascertainment of fact, or the improvement of Natural Knowledge. I say 
“educational discipline” because such experience trains the mind and deepens the 
judgment for innumerable ancillary decisions, on which the value or cogency of an 
experimental programme depends. A man with five, or ten or fifteen years experience 
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given to such discipline has been himself profoundly modified in his capacity for the 
direction of such work. He has. as we say, learnt by experience, and this effect will 
be the more profound the more deeply his thought has been immersed in his problems. 
Such men. if they have the taste and gift for ex|*osition. should lie the authors of our 
text-books on Experimental Design, and the teachers and directors of our advanced 
schools of statistics. 


For. in truth, the Design of Experiments is not. as it might have been thought 
but a few years ago, a casual extension of statistical studies, hut is central to the whole 
process of the Natural .Sciences, fn this process we proceed from observational data, 
imperfect indeed in that they an* qualified by errors of measurement, and by errors 
of random sampling, to conclusions.which by reason of these imperfections are subject 
to some uncertainty, which may. none the less, he an uncertainty of a rigorously well- 
defined kind. The strongest possible type of statement of uncertainty to which our 
investigations can lead are statements of Mathematical Probability, as understood by 
the great French mathematicians of the 17th century. The possibility of inferring 
such statements depends on the quality of the data which provide the premises of the 
inference. To ensure that the data shall provide a logical foundation for inferring 
exact statements of mathematical probability is one of the tasks to he considered in 
experimental design. 

4. Mathematical probability 

I have in recent years made use of a definition, or semantic analysis, of the con¬ 
cept of mathematical probability intended to bring out more thoroughly both the logj. 
cal and the naturalistic aspects of this concept, than is done by such bare phrases ns 
'the frequency theory *. I conceive that there are three requirements for a probability 
statement which shall he precisely defined and valid in the real world. First, it must 
imply a Reference Set, a well defined mathematical construct, which must be measur¬ 
able in the sense that members of a precise fraction, P, of the whole set possess some 
characteristic absent from the others. This defines the strictly mathematical aspect 
of the concept, and sulficcs to ensure that the statement of probability shall be exact. 
Secondly, we require that the subject of the probability statement shall bo a member 
of the Set; this is the specifically scientific or naturalistic aspect, which must be taken 
care of by experimental design. For. it entails the characteristically scientific processes 
of recognition and identification. Finally, there is the specifically logical require- 
ment that no subset having a fraction different from />, can be recognised. Such 
subsets always exist. Their non-rccognisability is a postulate of ignorance for if 
the nature and extent of our uncertainty is to be well defined, it is necessary to specify 
our ignorance just as exactly as our knowledge. Manifestly, if the subject did 
belong to such a recognisable subset the latter would replace the original set as the 
appropriate basis, for the probability statement. 


11 tk.t this specification may be called a frequency thorny of 

b lerifi d 7 T 1 thC V ‘ IU ° ° f ' hC P ‘ 0babllit >' ™ay theoretically 

tended to any chosen degree of. approximation by sampling the Reference Sot 
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and this. I believe, is the only meaning that can be attached to the phrase frequency 
theory". The three distinct stipulations 1 have made have however distinct purposes 
in satisfying the three requirements, first, that the statement shall be mathematically 
exact; secondly, that it shall be valid in the real world of the Natural Sciences, and 
thirdly that it shall incorporate a rigorous specification of the nature and extent of 
the uncertainty. 


5. Measurement in nature 

If. then, it be proposed to obtain knowledge of some quantitative property 
of the real world, such as Planck's constant of angular momentum, the atomic weight 
of some chemical element, the average number of vertebrae in the European eel, or 
the time constant of the expanding universe, though we cannot attain to absolute 
exactness, yet we may aim to base our knowledge on data good enough to lead by 
a rigorous argument to precise statements of probability, rather than to those weaker 
levels of uncertainty represented by Mathematical Likelihood, or only by tests of 
significance. The conclusion of our induction will be of the form : 


P,(x < *,) - P, 


asserting that the Mathematical Probability that the unknown x be less than rt 
value calculable with exactitude from the observations, is equal to P for all values 
of P from 0 to 1. In other words we shall express the unknown as a Random Variable, 
not imagining that it has more than one value, but incorporating in our conclusion 
the fact that within a restricted region we do not know what value it has. just as the 
gambler of the 17th century, did not imagine that the die he was about to throw 
would turn up simultaneously all six faces, but in stating that the probability of an 
Ace was just 1/6, asserted by implication that he did not know which face it would be. 


The task we have thrown upon experimental design of providing data good 
enough to support conclusions of this definite kind is not prima facie a difficult one, 
although technical knowledge of the material would be required for confidence in 
whatever method suggests itself. If in any problem of this sort the experimenter s 
mastery of his material is such that he can obtain, a Normal sample of say. ten or a 
dozen independent measurements which, though inexact, are collectively unbiased, 
and of equal precision, then he can provide the empirical basis for such a continuum 
of probability statements, strict as are the mathematical conditions for such an ou - 
come. Though the mathematics are familiar, the logic, which is equa > ngoious, 
seems not to be so widely appreciated. 


A random -ample of A' from any Normal population may bo characterised 
by three quantities, the population mean. the sample mean *, and the est,mated 
standard deviation s, calculated from : 


N(N-l)s* = S?(x-X)* 
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such trieds of values, appropriate to all random samples from all |>o.ssible Normal 
populations, constitute our Reference Set. which is thus rigorously defined. Some 
members of this set, but not all, will satisfy the inequality : 

// < X+st r 

and if t p is calculated so that : 

P,(t < *,) = P, 

whatever may be the parent population, and for any chosen value of P, then, since the 
definition of t is : 

/= €=? 

8 

the frequency with which the inequality is satisfied in the Reference Set must be equal 
to P. Knowing x and 8 for his particular data the experimenter may thus easily infer 
the specification of the unknown // as a Random Variable. Tho mathematical part 
of the inference is simple in this case: it is provided by Student’s distribution of I. 
which has been adequately tabulated. In its logical aspect two further stipulations 
are required. 

6. Logical and operative conditions 

If Bayesian probability a priori had been available, that is to say. if the cons¬ 
tant to be determined were expressible prior to the observation* exactly as a random 
variable, we should projwrly use the method of Bayes to arrive at the distribution a 
posteriori appropriate to tho observations. This is indeed a dream from fairyland 
for we do not in fuel, prior to observation, possess such a continuum of exact probabi¬ 
lity statements. However, if indeed we did. it would bo very wrong to ignore them, 
and Bayes argument is available for just this case, and for the more realistic one in 
which an auxiliary experiment can be used to supply this ingredient of Bayes’ argu¬ 
ment. 

Secondly, if the statistics x and s used in our inequality had not been jointly 
exhaustive for the estimation of the two parameters of the Normal distribution, it would 
have been possible to And some third statistic such that its distribution, subject to 
constrained values of x and .t. still depended to some extent on the unknown //. Such 
a statistic would, in fact, define a recognisable subset within the general elass of random 
samples of a given size from Normal populations, justifying different probability 
statements from those we have inferred. 

The validity of the inductive argument has, then, the logical requirements 
that prior to observation the unknown is not already expressed exactly as random 
variable, and that the statistics used in the probability statements inferred should 
jointly constitute an exhaustive set. To lead to estimation problems admitting of 
exhaustive estimates is therefore a reasonable aim for an experimental programme, 
which is fully realized if can obtain such a Normal sample as I have supposed. 

Many experimenters will consider, at first sight that the task which in this 
example, we have assigned to experimental design is an easy one. It does seem none 
the less, to deserve some thought, and some precautions. The mere fact that X 
14 
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values are presented to the statistician does not justify him in accepting them as a 
random sample from a Normal population. Measurements, each with its own compo¬ 
nents of error, but collectively unbiased are the sort of observational material from 
which such a situation was first inferred. When steps are taken to improve the 
accuracy of a measurement, the largest and simplest sources of error are first elimi¬ 
nated. there remain smaller, but more numerous, components having collectively a 
smaller variance. The limit of this process, closely approached in all measurements 
of precision, is the Gaussian or Normal form. 

The experimenter may now consider that he wants his observations to be 
collectively unbiased, independent, and of equal precision. The policy adopted by many 
pharmaceutical firms in making essays of the potency of pharmaceutical preparations 
affords the best answer to which I can point to the experimenters problem under these 
heads. Recognizing that systematic errors inevitably affect the determinations in any 
one laboratory or department, so that repeated determinations by the same depart¬ 
ment are not truly independent, the collaboration of several laboratories is obtained, 
and though it is often useful for each laboratory to make a number of parallel deter¬ 
minations, as independently as it can, yet the variance among these will not bo used 
in the estimation of error, but rather as an internal confirmation of that estimate, 
which will itself be based exclusively on the variation among laboratories. So, if 
there were eight laboratories each performing five parallel measurements, the thirty 
two degrees of freedom within laboratories are confirmatory only, and should givo 
a mean square somewhat less, and sometimes strikingly less, than the seven degrees 
of freedom among laboratories. 

For equality of precision it is necessary that the number of repetitions shall 
be the same in each laboratory. The apparatus, balances, glass-ware, standard 
preagents, etc. will be different, though they may be supplied by the same firms, or 
approved by the same standardizing authority. Scientists and technicians will, of 
course, be different, but sensibly equivalent in capacity and experience. They should 
not be required to undertake tasks involving exceptional personal skill. The different 
department* should accept in advance, after due discussion, and carry out without 
variation, an agreed programme including schedules of interim computations. An 
erroneous mathematical theory connecting the crude readings with the quantities 
to be measured Will still introduce a bias affecting all departments equally, but this 
can be removed easily at a later stage, if the mathematics arc corrected. 

Without part icularizing the special object in view, and speaking to our audience 
with wide theoretical interests, it would be impossible to descend to the technical 
details of any such research. I have however, thought it worthwhile to emphasize 
that the design of experiments is a subject with not only mathematical, but also scienti¬ 
fic and logical aspects. And that the thoroughness with which the logic and the 
mathematics have been explored with respect to the Gaussian sample, should not 
blin.l vis to the fact that the production of jood data of this kind is a technological 
accomplishment worthy to sustain the ,«rfcctcd form of inference which such data 
make possible. 
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By MAURICE FRRCHET 
Academy of Sciences. Paris 

Summary. 

From hi# discovery of monogenic functions Emile Borcl was led to define the 
‘Asymptotic mensure' of a set of measure zero. Through his studies on prohuhility, 
he was later on brought to define an analogous motion, ‘rarefaction.’ to establish 
a classification and a scale among ‘zero' probabilities. 

Introduction 

In one of bis later works. Borcl (1940) has devoted one chapter to a qualita¬ 
tive definition of the inequality of the rarefactions of two (linear) sets of measure zero. 
This is a brilliant, and novel idea which has not so far evoked the attention it deserves. 
(I myself came to know about it only at the time of the preparation of a bibliographic 
note on mile Borel, which is going to appear in the form of a separate monograph 
in the collection of monographs L'enseignement Mathemalique, published from 
Geneva). 

But Borel's definition suffers from certain difficulties, and I had thought it 
fit to modify it slightly (in the form indicated in what follows) and to generalise it 
in one of my first notes on rarefaction published in the Com pies Haul us of the Academy 
of Sciences, February 1961. (We shall recall further on p. 108 the relevant 
definitions). 

In the present note (which will bo developed elsewhere*), wc have indicated 
that countable sets are all ‘of the same order’ of rarefaction, that is to say, among anv 
two of these, no one is more rarefied than the other, and that each one* of these is at 
least as rarefied as any set of measure zero. However, countable sets, which are simpler 
than other sets, intuitively appear to be more rarefied than others. This is what wc 
have attempted several times to demonstrate logically in the particular case of two 
sets: one, the simplest of the countable sets, namely, the set of a single point a; and the 
other, the ternary set C of Cantor (this is one of the simpler and well-known examples 
of an unaccountable set of measure zero). But as a result of our repeated failure to 
demonstrate this, tee have ultimately posed the question xvhether this result, which appeared 
intuitively probable , might not be mathematically false. This question has, in fact been 
answered in the affirmative. In this article we shaU give a demonstration. 

• Under publication in Annals de VEccU Normale Suptrieure, 
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Wo shall first recall the definitions of the note mentioned above. 

Let Sm„ and be two convergent series whose terms arc all positive. 
According to Borel, the first series converges more rapidly than the second if the ratio 
of the corresponding w-th remainders 


y »+fg ± »± i " ... (1) 

tends to infinity with n. 

Let E be a linear set of measure zero. We shall say that a sequence of inter¬ 
vals A'„ A' 2 , ... majorises E if : 

( 1 ) the series formed by the lengths of these intervals is convergent; 

(2) every point of E belongs to an infinite number of these intervals; and 

(3) each of these intervals contains at least one point of E. (Everywhere in 
this article we shall distinguish between an interval x' < x< x“ and a segment 
x' < x < or"). Lastly, we shall say that E is more rarefied than a set F of measure 
zero, if there exists at least one sequence of intervals which majorises E and which 
converges more rapidly (this phrase is an abbreviation of the more explicit phrase 
“...which majorises E. and is such that the series formed by its lengths converges 
more rapidly...’) than every sequence of intervals which majorises F. We shall write 

rar E > rar F. 

Cantor's ternary set C is, of course, the set of points of the segment (0,1) whose ternary 
expansion contains only the numbers 0 and 2. Every point of C belongs to each row 
of the sequence T of what we shall call (for the purpose of this article only) the 
‘classical intervals' I v / 2 . ... 


T < 


°<*< M <x<1 


each of length 


• ** »* 


°<*< I’ 9 <*<VT<*<9’ 9 <*<* 


the <y-th row comprises only of intervals each of length 


3 

1 

3* 

1 

3* 


It is clear that if two classical intervals are distinct, then they are either disjoint or 
one is smaller than the other and is contained in it. 

Proof 

We wish to demonstrate that the relation 

rar a > rar C 

i8 not true or. in other words, that for every sequence of intervals which majorises a 
there is at least one sequence which majorises C and for which the ratio corresponding 
to equation (1) does not tend to infinity with n. 


ON RAREFACTION 


100 


If S *<„ is any convergent series of positive terms, there exists a sequence of 
intervals which majorises a and for which S u„ is the series of lengths, and m\ finely. 
It is, thus, enough to prove that for every convergent scries E u„ with positive teims, 
there exists a sequence 8, which majcrises C and for which pjr n does not tend to 
infinity with n, where r„ and p„ are the n-th remainders of the series E n„ and of the 
series of lengths of 8., respectively. Let us denote by /r an increasing sequence of 
integers 

*i < s t < — <**< — 

For S„ we shall take the sequence of classical intervals of lengths \ , \ , .... . ••• 

3 1 3 *’ •'» 

(by arranging from left to right the intervals of equal length, as in the Table). 

We shall now show that to every convergent series E u„ of positive terms 
it is possible to associate a sequence 8„ in such a manner that pjr m does not tend to 
infinity. 

Let A be any positive number. Evidently, it suffices to show that, given 

E u„, we can choose the sequence rr in such a manner that < A for an infinity 

of values of w. To show this, let us observe that the number of classical intervals of 

length i- is 2**. For every integer w, we can find a corresponding number such 
3 * p 

that 
either 


or 


1 < n < 2*' 

+ + < it 2 ,, + ...4-2'' _ a„. 

The sequence S„ is composed of 2*' classical intervals of length ^ ,..., 2‘ ,p ”' 


p-\ 


intervals of length 1 and of one or at most 2 * p intervals of length 
3**" 1 

Let us consider, in particular, the number n = +1 = The »-th 

term of 8„ will then be the first of the classical intervals of length and we shall 

3 «„ 

have 




r " - r h- 

Wo want to show that p„ < Ar$ p . 
Now, s p+# > s p +q, 

2\ s * f. . 2 . /2 


... (2) 


from which wc get Pn < (-) * [l+ |+(j) +...]= 3 
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Hence, in order to have equation ( 2 ), it suffices to have 

Now, fl p = 2'* + . • - + 2 tp ~ l +1. 

Hence if « |t ... have been chosen, r$ p is determined, and we can verify equation 

(3) by taking s p sufficiently largo (with s p > s p _,). 

It is thus proved that the point a is not more rarefied than C or, in other words, 
that the relation rar a > rar C is not true. But we have mentioned above that 
no set of measure zero is more rarefied than a countable set. We see, thus, that neither 

rar a < rar C, nor rar C > rar a. 

This will be expressed by saying that a and C are of the same order of rarefaction. 

rar a s: rar C. 

Remark : Since the above article was written, several notes on "rarefaction" 
have appeared in the Comptes Rendns de VAcademic den Sciences {see references below). 
But much remains to be clone on the subject which may be of interest to young mathe¬ 
maticians who aro looking for questions to be studied and resolved. 
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THE ESTIMATION AND INTERPRETATION OF GROSS 
DIFFERENCES AND THE SIMPLE RESPONSE VARIANCE 


By MORRIS H. HANSEN, WILLIAM N. HURWIT/ 

and 

LEON PRITZKER 
Hurt.au of the Census, U.8.A. 

I. Introduction’ 

We are honoured to have the opportunity to participate in this tribute to 
Professor P. C. Mahalanobis. In his work in the lato 1930’s when he was concerned 
with the design of surveys for measuring the acreage and production of jute in 
Bengal, as well us in many other statistical surveys that followed, the record is clear 
that Professor Mahalanobis had a broad view of the task of the statistician engaged 
in statistical surveys. In stressing that all the resources provided for a survey should 
bo used optimally, he equated the design and operation of a large-scale statistical 
survey with “statistical engineering" (1046). Thus his view of optimization went 
beyond the mathematically tractable proposition that the sampling error should be 
minimized for a fixed cost (or that the cost should bo minimized for a fixed level of 
sampling error). Although Professor Mahalanobis has been concerned with mathe¬ 
matical rigour, he hus first- and foremost bcon concerned with statistical practice. 
Thus, note the criteria developed by him and his co-workers for the survey of the 
area under jute in Bengal : 

"The reliability of the sample survey must bo such that the margin of error 
of the final estimate of the area under jute should not exceed 5%; secondly, the results 
must be available suthciently early in the jute season and preferably by the first or 
second week of September; and finally, the cost of the sample survey should not be 
excessive.” (Mahalanobis, 1944, pp. 332-333). 

This same philosophy has guided the efforts at the U.S. Bureau of the Census 
for the last quarter of a century, and has been translated into mathematical theory, 
experimentation, and the design and planning of statistical surveys. 

The development of theory and methods for the measurement of accuracy 
of survey results serves three needs. One need is to provide the planner and designer 
of surveys with inputs for improving his work. A second is to control the survey 
process in order to provide some assurance that field workers, respondents and data 
processors are operating in accordance with the specffications provided them. A 
third need is to evaluate tho results of the survey so as to provide the users with infor¬ 
mation to guide them in the decision processes in which the results of the survey 
are employed. While measurement of accuracy should be an important guido to the 
users of data, the education of users in the proper interpretation of accuracy measure¬ 
ments has not been sufficiently effective. Continued effort in this type of educational 
work is sorely needed. 
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A recent summary by Dalcnius (11M52) is useful for stating our present purposes: 

' In the lt*40's two lines of development emerged in the work dealing with 
non-sampling errors: 

(1) Development of theory and methods for coping with specific sources of 
non-sampling errors. 

(2) Development of a comprehensive theory of non-sampling errors, or in 
the present terminology, of mixed error models.” 

We shall outline certain recent developments along these lines. Our primary 
aim is to make available to the “statistical engineer” some of our theoretical and 
experimental work on “gross-difference measurement.” This is a measurement of 
discrepancy or difference obtained from the re|>etition of a survey or the use of 
an improved survey procedure, and is explicitly defined below. 

2. Criteria for design of statistical surveys 

Any practicing statistician must take into account at least the following design 
criteria : 

(1) The definition of objectives. 

(2) The amount of resources to be expended. 

(3) The rate at which the resources are to be expended in real time. (The 
choice of the starting point is often a crucial consideration.) 

There are some possibilities for serious error in the very first step, the deli- 
nit ion of objectives: Suppose it were possible to measure some unambiguous aspects 
of economic behaviour without error. Suppose the measurement was in the form of 
an average for a defined population at a s|>ecified time (U r ). The reason for wanting 
this measurement stems from the belief, say of a group of economists, that U T will 
be an excellent predictor of some other aspect of economic activity at a later time 
( Vt+k)> which will also be known at time ( T+K ). It may turn out, however, that the 
economists are wrong and the 0 r is not a good predictor. This is an example of what 
has been called “programming error.” The treatment of this type of error is largely 
(but not entirely) outside of the sphere of the survey statistician. Ho must, however, 
be aware of the possibility and work cooperatively with economists, sociologists, etc. 
to avoid this type of error. 

The theory and the design practices that have been developed at the Bureau 
of the Census attempt to optimize the use (and tho timing of the use) of resources. 
We generally presuppose that we know what we want—that we want to measure 
D r . The long-run objective of our theoretical and experimental work is to minimize 
the mean square error of an estimate of 0 T , say X Tl , for a fixed cost and subject to 
other conditions, where the T indicates the reference period of tho measurement 
and / indicates the occasion, or “trial” on which the measurement was actually made. 

There is no theory available that provides the“best design,” in the sense defined 
above, to select one survey design out of tho set of all possible alternatives. In fact 
there is no theory available to select the best sampling design from all possible alter¬ 
natives. Advances in theory and methods directed towards minimizing the moan 
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square error of a statistic—where the mean square error reflects all the errors of 
measurement as well as sampling error—will continue over many years of research 
and development. We must study systematically such questions as the impact ot 
variations in questionnaire design or in other measurement processes, survey proce¬ 
dures, the training of interviewers and respondents and a multitude of other factors 
that the designer now must consider intuitively in creating a particular survey. 

The survey designer is confronted with various conflicts in his decision-making. 
A decision that may he optimal from the sampling point of view may he far from 
that from the point of view of measurement error. For example, sampling considera¬ 
tions might call for a widespread sample with little clustering. A concern about 
measurement error, however, might ho reflected in stringent requirements for training 
and supervision to control the field work. Thus, the survey designer may choose to 
confine the sample to a samplo of large clusters in which supervisory inspection and 
control can ho more fully exercised. 

Somo progress has been made in the long-run task of constructing a genoral 
theory or model of survey design. This theory, although at an early stage of develop¬ 
ment, has guided some significant experimental work at the Bureau of the Census 
which in turn has led to rathor important decisions in the design of censuses. 

We shall now examine this theory, and consider some of the practical impli¬ 
cations suggested by it. 

3. The model 1 

Although the model is applicable to both variables and attributes, we shall 
consider the measurement of attributes and thus the errors of measurement that arise 
in processes of classification. Our goal is to develop measures of error for the statistics 
that arise from such processes, c.g., measures of error for specified age, income, and 
occupation classes for wliich statistics aro compiled in a census or survey of population: 
or for kind-of-cconomic-activity and Icvel-of-cconomic-activity classes for which 
statistics are compiled in an economic survey or census. 

(A) Postulates : We postulate the following : 

(1) An unequivocal rule exists for determining the units in a population in 
a fixed area and at a fixed reference period. Thus we can identify (and select for a 
sample by some probability mechanism) the j -th element of any defined population 
of N elements. 

(2) While, in goneral, we are not able to determine in practice the true value 
of an attribute of interest, U jt for any element, we postulate that the goal (or unattain¬ 
able ideal) of a survey is the true value of the proportion of the population having a 
specified characteristic. Thus the desired proportion, estimated by the statistic 
actually obtained in a survey, is U where : 






... (1) 


15 


i This discussion is based on a paper, by Hansen, Hunriti and Bershad (1961). 
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(3) A set of conditions, G, under which a particular survey or census is taken. 
Wo are in general not able to control or even to identify all of the conditions influencing 
the outcome of a survey. We do control some of them, however, either by fixing 
them or by systematically varying them. The uncontrolled conditions are reflected 
in chance variations in response. 

(4) Thus, we postulate a survey procedure — not attainable in the real world 
—in which the process of recording a response for any element in a survey is (i) repeat- 
able and (ii) gives rise to a random variable whose value at trial t is not correlated with 
its value on any other trial (fd-fc).* 

(B) Definitions : Thus, we shall be dealing with a random variable, x jl0 , 
whose value is : 

1, if the recorded response classifies element j as having some charac¬ 
teristic on trial t of a survey conducted under a set of general condi- 
Xjta = ^ tions G. (x may denote the age-class “0—4,” the income class 

“$ 10,000 and over,” etc.) 

L 0, if otherwise. 

Then the average value of x is the proportion classified as having the specified charac¬ 
teristic in trial t of a survey of n, elements : 


I 5 

Pio = ~~ Z x j0 . 
n i l 


( 2 ) 


The task of evaluation, when viewed from this standpoint, is to obtain ostimat&s 
of the mean square error (MSE) of p, a for the classes of the population for which survey 
data arc tabulated, for example, 5-year age classes, categories of income, or the number 
of years of regular schooling completed. Thus : 

MSE*„= £(*,„-0) ... (3) 

where the expectation is taken over trials and where 0, as defined above, is tho true 
proportion in the population. 

The mean square error can be divided into its two main components by sub¬ 
tracting and adding E(p ia ) inside the parentheses of equation (3). 

We define B( Pto ) = P,; and : 


MSE,^ 


Bipn-PoV+iPa-V)* 



(4) 

( 5 ) 


where the first term is the total variance of p ta and the second term is the square of 
the bias of p lo . While we are unable to measure the bias term in practice, we can 

sometimes define and estimate useful approximations to it. 

To express the variance of Pto in a particularly fruitful way, 
let E(Xjta) = Pjo . 0 < PjQ < 1 ‘ _ 

* ThiK. for 0-1 variates, is equivalent to independence. 
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where the expectation is over trials for a fixed element of the population. Then, 
as a dovico to be used for separating the response variance from the total variance, 

lot P 0 =izP, 0 . ••• < 0 ) 

n t i 

This is the average of the expected values for the elements of the sample drawn on 
trial t. 

Then tr\ u = E( VlG -P 0 +P 0 -P a ) x 

= RiPto-PaY+EiPo-Par+mPio-PoKfo-Po)- - (V 

In (7), tho first term is defined as the response variance, the second term as the sampl¬ 
ing variance, and tho third as the interaction. 

(C) The response variance. Our interest in this paper lies, primarily, in the 
response variance. 


Let of = E(p l0 -P 0 )* = E(if 0 ) ... (8) 

where <**, = (x Jl0 -P J0 ) ... (9a) 

is the response deviation, i.e., the deviation of the response recorded for elomont j 
on trial t from tho oxpected value of the responses for that clement over all trials, 

and H, a =i- E d i0 . ... (9b) 

n t i 

The following indicates how the response variance, (8), may be expressed 
in terms of responso deviations defined by (9a) : 


- E(p„-P a )' 

from equations (2) and (6) 





s 


Q ® + ^ ■'*■«) • - <*°> 

Thus, for a fixed sample size, n, = n 

E(d ll0 d M ). ... (11) 

The partition of tho response variance provided by (11) gives a useful tool for 
the analysis of sources of reliability. The first term of (11) is the simple variance of 
tho response deviations. The second term reflects any correlations among the res¬ 
ponse dev.at.ons wthin a survey trial, and thus correlations among elements In 
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referring to it we shall use the phrase, “within-trial covariance of response deviations,” 
to distinguish this term from the “between-trial covariance of response deviations” 
to be described below. 

(D) The simple resjtonse variance. The basic trial-to-trial variability in 
response, averaged over the elements in the population, is termed the simple response 
variance, (It is analogous to the variance of a “simple random sample." as custo¬ 

marily defined in finite population sampling.) 

By definition of a variance : 

o* 4a = E(dJ t0 )-[E(d it0 )Y ... (12a) 

But E(d it0 ) = 0. 

Hence o\ 0 = E(<f* tQ ). ... (12b) 

A useful analogy for understanding the simplo response variance is the fol¬ 
lowing : 

For every element of tho population, j, there is a separate coin that has the 
probability Pia of coming up heads when tossed (equivalent to assigning x )iU a value 
of 1) and thus the probability (1— P J(i ) of coming up tails (equivalent to assigning x ilu 
a value of 0). Thus the simplo response variance is solely a function of the probabi¬ 
lities, as is demonstrated by the following : 

From equations (12b) and (9a) : 

<r2„ = E(d%o) = E(x Jl0 -P iU )* 

= E E(xlo-'2x ilo P iU + P* ia )- - (»2c) 

i t 

Noting that xf, G = x )lu . and taking the expected value over trials for a fixed element 


<r\a = E (Pfo — Pfa)- - (™) 

Finally, taking the expected value over all elements in the population 

< r 3 0 = ^ xp„<i-p„) - ('•*) 

Wo shall give principal attention in this paper to the simple response variance, 
but first we shall review very briefly in the next section the effect of within-trial 
correlated response deviations among elements. 

(E) Within-trial covariance of response deviations. Under certain fairly 
common circumstances, the more important component of the response variance is 
the second term of equation (11), reflecting the covariance of response deviations 
of different elements on the same trial. Writing this covariance as a correlation 
coefficient gives : 


= — {o\o-\-C 4 o) 

n 


(15b) 



where 
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^ (»-!)• - (,0) 

The possible impact of even a very small intraclaas correlation is substantial, 
as can be seen from an examination of equation (15a). For example, if the intraclaw 
correlation among response deviations is zero, the response variance of P„, is ~ 
Suppose, on the other hand, that the intraclass correlation is. say, .01 (u correlation 
so small that it might in other applications be regarded as of no consequence whatever). 
Suppose, also, that the sample or census involves the enumeration of w = 3.000 cases. 
Then the factor of />(»-!) = .01(2,909) =* 30. or 3.000 per cent! Thus, even if the 
simple response variance is relatively small, C iQ and, therefore, the total response 
variance o 2 , may become quite largo when the product p(n —1) is large. 

The Bureau of the Census has conducted three large-scale research projects 
designed to provide estimates of C 4G . 

(1) The Enumerator Variability Study of the 1950 Census reported in papers 
by Eckler and Hurwitz (1958), by Hanson and Marks (1958). by Hansen. Hurwitz. 
and Bershad (1961). and in a technical paper of the Bureau of the Census, "The 
Accuracy of Census Results With And Without Sampling' (1900a). The Enumerator 
Variability Study had an exceedingly important impact on the design of the 1960 
Census. 

(2) The Enumerator Variability Study of the 1959 Census of Agriculture 

(1962). 

(3) The Response Variability Study of the 1960 Census of Population and 
Housing, the design of which is reported in a paper by Hansen, Pritzker, and Steinberg 
(1959). 

It should be noted that the method of “interpenetrating samples," closely 
identified with Mahalanobis, had a key role in all of this work. 

4. Simple response variance : some useful relationships and 

APPROXIMATE ESTIMATORS 

(A) Derivation of an index of inconsistency. Assume that a sample of n 
oloinonts is drawn by an equal probability selection mechanism with replacement. 
Assume further that the within-trial (bctwecn-clcmcnt) covariance of response devia¬ 
tions is zero. Then the total variance, defined in (7). of the statistic p, 0 reduces to 
the sum of the sample response variance and the simple random sampling variance. 

Thus, for a sample of one element, the total variance is : 

”l l0 - E(x m -P 0 )’ 

= E( x liQ — PjO + PjO — Po)* 

= .o-P,o)'+E(P l 0 -P a )* 

= (P,a-p 0 r- 
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Th,IS =y f P ,o('-P,o)+± £ (P i 0 -Pa)> 

= P 0 (l—P 0 ). ... (17) 

Thus, in terms of this model, the binomial variance, P o (\—P 0 ), usually cited 
ns the sampling variance of a simple random sample with replacement, may include 
a response-variance component, and is the sum of the simple response variance and the 
"pure" sampling variance! And, under the conditions stated, we have the interesting 
relationship that : 


Ro < Pd\—P a ). ... (18) 

Also with no change in P Q , any change in the precision of the measuring process 
has no oflect. on the total variance : The total variance is the customary variance of 
the binomial. As the measurement becomes less reliable, but remains unbiased, the 
simple response variance increases and the sampling variance decreases. In the limit, 
when the measurement process consists of tossing the same coin for each clement 
(i.e., 0<Pj< 1, and constant for all j) the response variance is equal to the total 
variance. In the other extreme when P i = 0 or 1, i.e., there is no response variabi¬ 
lity; the sampling variance is equal to the total variance. This relationship suggests 
n useful index of the unreliability or inconsistency of classification : 

I to " p (i — P J * n< * ex inconsistency. ... (19) 

It is cloar from equation (17) that 


I40 < 

(B) Estimators of the index of inconsistency. The denominator of the indox 
can be estimated readily with the survoy result p lo as the estimator of P a . Thus, 
the problem is to find an estimator for Re¬ 
consider some kind of “repetition” (<') of a survey (<), designed to estimate 
the same proportion, 0. The conditions of the “repetition” (O') may or may not be 
the same as those of the survey ( G). The sample, however, consists of the identical 
elements on both trials. Thus, the pair of trials, t and t' would generate the following 
type of table, where we desire to estimate, say, the proportion of a population aged 
15-19 years old : 


repetition 

survey 

I 

ago 15-19 

age not 16-19 
xj lo ~0 


ngc 

15-19 

V®'" 1 

a 

b 

a + 6 

ago 

not 15-19 

i 

e 

d 

■ ■ J 

e + d 


a+e b+d » 
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The values in the table, a, 6, c and d are the frequencies observed in the pair of trials, 
and 

n, — a+6+c-fd = n t . = n. 

Thus, for each element drawn at random from the population, we can observe the 
difference : x JIO —x Jt . a .. 

Then let 


9 = -Stow-***#')*. 
n > 


... (20) 


And E(g) = - E{*jto —Xji'O')* 

= E(xj IG )+E{x* l . 0 .)-2E(x Jia x H . a .). ... (21) 

Since x jl0 and x^. take on only the values 1 or 0, xj ia = x^ u , and xj,, a . — x it . u ,. 

Thus, (21) may be rewritten : 

&(9) - E(x ho )+#( xw)-2E(x il0 x Jt . 0 .) ... (22) 

= r 0 +ro—*Poo' ... (23) 

where Paw »» the probability that an element takes on the value 1 on both trials. 

If 0 and O' represent the same survey conditions and / and t' denote inde¬ 
pendent repetitions on a singlo element, (22) becomes : 

E(9) - 2P 0 -2E(Pt 0 ) - (24a) 




2 SPjril-P*) 

*—*■——jy -- ... (24b) 

Thus, from (14) E(g) *= 2<rjg. ... ( 2 5) 

It follows that g/2 provides an unbiased estimate of the simple response variance 
whon 0 and G' represent tho samo survey conditions and t and V denote independent 
repetitions on tho same eloments. 

Now, let us examine how the quantity g, defined in (20) is related to the four- 
fold table displayed on page 118. From (20) 


-i i^+Lixi-o— 

~Z*i,o+ l Zx,.,,.-! 


_ a+c q-f6 2a 

n n n 


• O* 


• •• 


( 26 ) 
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We define this estimator ns the ‘ gross-difference rate.” 

When G and G' denote independent replications, the gross-difference rate 
(</) and estimates of P G provide a consistent estimate of the index of inconsistency, 
I dG , as defined in (19). One estimator that we have used is : 


ida 


2 Pioi 1 —Pto) 


(27a) 


Another estimator takes advantage of the estimates from the survey and the 
replication, and uses an average denominator : 


/ 


ida 


*lP,o(l- P,o) +Pfo'(' -Pro') 1 
2 


=_£- ... (27b) 

Pio ( 1 — Pto)+Prat 1 —Pro) 

Often, we cannot do independent replications of a survey, and in this situation the 
above estimators tend to be biased. This is discussed further in Sections D and E 
below. 

(C) Gross-difference rale as un estimator of the variance of the net-difference 
rate. Before dealing with the experimental data available to estimate I d0 , it will bo 
useful to discuss the gross-difference rate, g, further as an estimator of the variance of 
the rate of net difference between two survey results based on an identical sample. 
The not-difforonco rate is : 

Pio—Pro •• 

Thus the variance of the net-difference rate may be written as : 

-P,. a . "*{» f WH*WV}* 


EXixj.o—Xj'.o')* EZ{x il0 —Xfi.Q. )(**<*— xm) 


r 


bm 


- (Po-Po’)*- — (28a) 

If the correlation between the differences, {x iia —x it , a >) and (**«;—*n«C') i* zero » 
then (28a) becomes : 


f i a p rtr 




... (28b) 


Ordinarily, we have found (P«-P*J*, ™ estimated by 10 be 

negligible. 

Thus, under these conditions : 


1 


... ( 29 ) 
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(D) The effect of correlation beticeen trials. Even where {//* will he a valid 
estimator of the variance of the net difference rate, one-half the gross-difference rate 
can be a poor estimator of the simple response variance. It will be a poor estimator 
when there is a large enough positive correlation among the response deviations on 
a survey and on the repetition. Thus, writing (21) in the form of response deviations 
gives : 

F(g) = vSo+v'Sg- ~ ~Pdc. jg- a do a do- + El P ju—^io- )*• • • • 

If P ja = P iu . for all j, as will be the case where the two surveys are taken under the 
same general conditions, it follows that: 



F{g) = o\ Q '\-O t 4„- — ^p40, 40' a 4G a du- 

... (31) 

And since <r$ 0 = 

<r$ u . (31) becomes 


where 

Fig) - ^da^-pdo. da-) 

... (32) 


Pdu.iu'^o * F(Xf, a — PjQ^X^.y. P )0 -)- 

... (33) 

Thus 

\ F{g)= a- a {\-p Jli <it ,). 

... (34) 


Therefore, for a between-trial covariance of response deviations that is jiositivc. this 
correlation is obviously positive, and one-half the gross-difference rate understates 
the simple response variance of the original survey. 


whrn Pda. do¬ 

l!»v simple re*pun»- vuriruico 

it 

ia uiidoro>tiniaU>d by 

+ •! 

io% 

+ -2 

SO 

. * 

+ .9 

• • 

90 

+ 1.0 

100 


When the correlation is negative, one-half the gross-difference rate overstates the simple 
response variance of the original survey by the samo percentages as indicated above. 
However, a negative correlation would not be ox|>ectod. 

Positive between-trial covariances of response deviations on successive trials 
are to be expected in practice because: 

(1) Even if the survey designer attempts to make the second trial independent 
of the hrst, the respondent may remember some of the results of the ti.*t trial, and tend 
to report the same answors. 

(2) The survey designer may specify that the responses on the second trial 
are to bo ' reconciled" with the responses on the first trial. The reconciliation is 
designed to produce a third response—a “better” answer. 

The existence of correlations in the attempts to repeat our surveys and censuses 
varim^ '"^'rotation of the gross-difference estimators of simple response 

16 
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(E) Kff<cl of " improved" procedure on yross-difference rate. Many of our 
estimated gross-difference rates are obtained when a census or a survey is followed 
by a post-enumeration survey," or an “evaluation survey.” If the intentions of the 
survey designer are realised, then the “post-enumeration survey” will be an improved 
procedure, relative to the original survey. 

We can illustrate the meaning of the statement that O' is an improved proce¬ 
dure relative to G, by listing the following hypothetical values for P ja and P ja . : 


P iO 


1.0 

1.0 

.u 

1.0 

.8 

.9 

.7 

.8 

.3 


.2 

.1 

.1 

0.0 

0.0 

0.0 


Where all the Pf s are 1 or 0, there is no response variance. As the values of 
some of the Pf* depart from I or 0 some response variance is introduced, as more of 
the Pf s approach .f> the response variance increases and the classification procedure 
becomes less reliable. In a highly reliable (and highly accurate) procedure, the values 
of P, will have the following properties 

(a) where the truo values (U t ) are 1, the Pfs will tend to 1; 

(b) where the true values (Uf) ure 0, the Pf s will tend to 0. 

Thus, we will assert : 


G' is an improved procedure over G, when 


for P f(J > .5, 


' > 1 
' < r ia i 


Hi 


I 

l 


(35) 

(b) for P ja < .5, P iQ . 

Let us compare the gross-difference rates obtained under two sots of 
circumstances : 

G' is an independent replication of G, in which event b und c follow : 

Po = P a - 
Pjo= J, io > al1 

G' is an improved procedure over G. 

The between trial-covariance of response deviations is zero; i.e. the res¬ 
ponse deviations of G' are independent of the response deviations of G. 
Pa — Eq> ■ 

We wish to prove that, on the average, the gross-difference rate obtained by 
replicating a survey is greater than the gross-difference rate obtained by following 
an initial survey by an improved survey, i.e.. 


•J 2 < 


b. 

c. 

a. 

b. 

c. 


Let 


Then 
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Theorem I : £(//,) > E(g t ). 

In order to prove Theorem 1, we first prove the following : 
Theorem 2 : B[Pjo(PjO' “ Pja)] > °- 

N„ — the number of elements in the population for which 

Pjo > « 

Pjo = -5+Aj. for j = I. N m 

Pjo =.5—A,, for j =» (N a + l),..., N. 


P[PiC^P) 0 '—Pjo) Pjo(Pio l ~Pjt)+ ^ P ja'—Pjo) 1 

l i-i >—AVfl J 


Since P f; = P, 


o' 


•V. 


Thus 
And since 


,r, {P io - p io)~ 

^[^ i , /> /0 ,-P j(I , + ^_S + J (P.o-/*,,;)] = 0. 
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(36) 

(37) 


(37n) 


(37b) 


(37c) 

(38a) 

(38b) 


A, > 0 for all 

P,o->P,o for j = 1 .A T # 

P »* < for j - (A T . + 1 ).A r 

A' ^( P iO'-P,o)- -P j0 )] > 0. 

Thus wo have proved Theorom 2. 3 

*t P ia(P» -Pja)]> 0. 

To prove Theorem I, we observe from (22) that in general 

__ _ _ ~ Po+P</- 2E(z ilo x ivo .). 

’The assumption that the response devotions'of O' are independent of' 
of C? was not u-od .n th.s proof. Abo. it can be shown that, in the general case wh en * P(r , 


... (38c) 

... (37) 
... (22a) 


E[P * {P tQ - p jQn>MP Q -P g ). 


(37d) 
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1’hen, recalling the conditions that specify g x and </ 2 : 


And, the difference : 


Then, by Theorem 2 


Mg,) = ■2Po-2E(Pf„) 

... (39a) 

= P 0 -E(Pf 0 ) 

... (39b) 

! Mg,) = Po-E(P, a P ln .). 

... (40) 

±-Mg,-g.) = E(P,„ P lo .)-E(Pf„) 

... (41a) 

= E[ PfalP$tr — P >«)]• 

... (41b) 

l Mg,—g t ) > n. 

... (42) 

both positive quantities, we have Theorem l. 4 


F4<j x ) > E(g t ). 

... (36) 


Before dealing further with the comparison of an "improved" procedure and 
an initial survey procedure, we shall need a third type of covariance. Up to now, 
we have dealt with two types of covariances of response deviations —within-trial and 
between-trial. Wo shall now need the between-procedure covariance of expected 
values : 


cov (GO') - mPto-PMPtv-Pa’) » WPjo P ia ,-P 0 Pa'] 

= P p )O r tO ,frr jO <Ti ’)O t 

where cr rja is the sampling variance, previously stated as a component of (7), i.o. 

mPju—Po) 1 - 


(43a) 

(43b) 


(44) 


Again, when Q' is an improved procedure, ns defined above, and given P a = P a >, 
wo shall prove 


Theorem 3 : 

p ****•" > °>#® 

... (45) 

From (43a), (44), and the 

condition that P a = P a • 


Pp i<> r fO' tr ''ia <Tr jo' 

<r* Pjo = mp*p*--p&)-mpfo- n) 

... (40a) 


— Ftp jp.« _p,„n 

... (46b) 


= “A*jeA r jO‘ 1 jot J. 


Hence, by Theorem 2 

Pr P ~~° p > °* 

' jo SO’ JO JO ' JO 

... (47) 

And, adding af> jo and dividing by tr Pja on both sides, we have 


Theorem 3: 

Pr p Vp > °> • 

JO JO ' )0' jo 

... (46) 


tie ..l*o bo ahown tlmt thin ihcomn hold* in giwml. i.o. when P a # Pq'. «» nd Q' «* on 
improved procedure over O. 
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Since the conditions that define an improved procedure imply that 
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therefore 


0 < Pr iO l ’,0' < 
> 


(4H) 


jo‘ ‘id 

As we have indicated earlier, the better the procedure the more the total 
variance consists of the sampling variance. 

Theorem 3 has the following interpretation : 

(a) Fix an initial survey procedure. G. Then fr,.^ is fixed. 

(b) Conceivo of a class of improved procedures, 0\, Q' t , 0 3 , .... each one of 
which is better than its predecessors. 

(c) Compare each improved procedure with the initial survey procedure. 
Then, as the procedure is improved, its sampling error (<r^,) increases at a 

faster rate than the correlation between the expected values (Pp }g r j(r ) decreases. 

When P 0 t* P a .\ it can bo shown that 

Pp P (Tp <r P > a*!- +(.5—P ( 0 ){Pq. — P a ). ... (4fia) 

p to P io■ p jo p >w io 

Among the class of "improved” procedures, wc shall define as the "best 
procedure (#•), that procedure which, relative to an initial survey procedure ( 0), 
satisfies the following conditions : 


(a) for P J0 > .5 

(b) for P i0 < .5 


to• 


'to* 


:} 


(49) 


Under these conditions, — the sampling variance — is a maximum and 
<**«•—t-he response variance —is zero. 

We now want to prove the following : 

Theorem 4 : Given 

(1) an initial survey procedure (t»). 

(2) a class of improved procedures (O') of which O* is the best. 

(3) the conditions (35 and 49) for ''improved" procedure and "best" procedure, 
*o'=* * a 

cov ((?(?•) > cov (GO'). ... (50) 

From (43a) 

cov (GG*)—cov (GG') = E(P ia P i 0 .)-E(P ja P i<r ) 

= E[P i0 (P j0 . ~P , 0 .)). 

By the same type of proof used for Theorem 2 

E[P^P ia .-P i0 )\ > 0. ... (52a) 

Thus cov (GO*)-cov (GG') > 0. ... ( 5 2b) 

And since the conditions imply that p and p p are positive, wc have 

to to- so r so» 


Then 


(4) P a = P„. = Pr* 


(51a) 

(51b) 


Theorem 4: 


cov (GG*) > cov (GG'). 


(50) 
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Kxper,men 'Tai- measurements of simple response variance 

(A) Intensive interview surveys after the 1950 and 1080 Censuses. The Post- 
enumeration Survey (PES) of the 1050 Census (Bureau of the Census. 1060b) as well a, 
one major study (Study EP- 10 ) of the Evaluation and Research Programme of the 1060 
l ensus (Pr,taker and Hanson, 1002) were both designed as attempts to obtain measures 
of bias m census statistics. Yet. since both studies provided for person-by-person 
comparisons of responses, it was possible to construct tables like the one on page 118 
above. Thus it was possible to compute estimates of indexes of inconsistency. Tho 
estimates for individual educational-attainment classes is given in Table 1. A summary 
ot average results for a number of different characteristics is shown in Table 2. 


TABLE I. PRELIMINARY ESTIMATES OK THE INDEX OK INCONSISTENCY ,? s \ 

TWFNTY^v'e YEiRr^ln MENT l ' LASSES KOK THK '"KNTKAI. POPULATION 
.NT\ FIN E \ EARS OLD AND OVER : I960 AND 1950 CENSUSES OF POPULATION 


oducntionnl. attainment oIann 

1900 Censun 

l950(Ym>urt - 

difference 

absolute relative 

(2)-<l) (3) + <2) 

(1) 

(2) 

(3) 

(•*) 


none 

.238 

.354 

.310 

.37 

elementary 

1-4 year* 

.309 

.300 

. 031 

14 

elementary 

5*0 yenm 

.333 

.479 

. 140 


olomontnry 

7 year- 

.399 

. 004 

.205 

• l»V 

*14 

Momentary 

8 yearn 

.300 

.400 

.100 

.23 

high school 

1-3 year* 

.240 

.375 

. 133 

.30 

high Hchool 

4 years 

.180 

.203 

.077 

.29 

college 

1 -3 years 

.224 

.339 

.115 

.34 

college 

4 or more yearn 

.074 

.170 

.090 

.30 


Source : Pritzker nnd Ifnnson (1902). 


TABLE 2. PRELIMINARY ESTIMATES OK THE AVERAOE INDEX OK 

INCONSISTENCY FOR SELECTED POPULATION STATISTICS : 
I9GO AND 1950 CENSUSES OK POPULATION 



characteristic 

estimated unweighted average index per elans 



1960 Census 

1950 Census 

differenro 
(2) —(1) 



(1) 

(2) 

(3) 

I. 

Sex 

.018 

n.a. 

n.n. 

2. 

race 

.045 

n.n. 

n.n. 

3. 

five-year age classes 

.054 

.070 

.010 

4. 

5. 

mobility-status classc*i 
educntional-ottainmont classes 

.120 

.3.35 

.215 


(population 25 years old and 
over only) 

. 250 

.394 

.138 


Source : Pritzker nnd Hnnuon (1902). 

i Mobility during a one-yenr |* ricd in 1950 nnd during n five-ycnr period in I9G0. 
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These estimated indexes of inconsistency arc undoubtedly biased down¬ 
wards because they are based on evaluation procedures that would tend to introduce 
positive belween-trial correlations bet ween response deviations for the same individuals. 
The evaluation-survey interviewer in each case was instructed to : 

(a) obtain the RES or Study ELMO response without any examination of the 
records of the Census response. 

(b) then, examine the record of the Census response, and 

(c) finally, if the two res]Mimses differed, determine I lie most accurute response 
(Census, evaluation survey, or some other). This was a procedure of ’'reconciliation,” 

Evidence from other programmes of the Bureau of the Census would suggest 
that two factors in the procedure tended to cause downward biases in the estimated 
indexes of inconsistency. One was providing the reinterviewer with the original 
data, and the other was requiring reconciliation. The first factor without the second 
would in itself produce a downward bias. (See U.S. Bureau of the Census, 11183.) 
Tabulations will subsequently become available of the results after stop (a) above; 
that is, of the differences before reconciliation. From these and the reconciled results, 
it may be possible to estimate the correlation and to make some inferences about the 
comparative quality of the two censuses as measured by the gross differences. How¬ 
ever, since both the reinterview procedure and the census procedures were presumably 
improved in 1900, a reduction in the gloss-difference rate before reconciliation will 
be consistent with any one of three hypotheses : (i) the simple rosponso varianco of the 
Census was reduced, or (ii) the simple response variance of the reinterview procedure 
was reduced, or (iii) both simple response variances were reduced. Further study 
or other evidence will be needed before wo can choose among the acceptable hypotheses. 

(B) CPS Reinteroiew Programme. We can get a closer look at the effect of 
correlations between response deviations on successive trials by examining the Re- 
interview Programme of the Current Population Survey (CPS). This programme, 
described in detail in a forthcoming technical paper (U.S. Bureau of the Census, 1963), 
is designed primarily to control the quality of performance of interviewers on a 
continuing basis, but also can servo to measure quality and to identify procedures 
and practices that may be improved. 

For the period, 1958 to present, the Reinterview Programme has had an experi¬ 
mental aspect that permits some assessment of the importance of the correlation between 
response deviations for identical persons on successive trials. An explicit source of 
this correlation is the reconciliation procedure in which reinterviewors compare, in 
the course of their reinterviews, the responses obtained in the actual CPS interviews 
with the responses obtained by them. The procedure is approximately as follows : 

(1) The person assigned to do the reinterview is instructed not to inspect 
original interview results prior to reinterview. Regional office personnel not assigned 
to field reinterview are designated to transcribe original CPS schedules, before editing 
to a CPS Reconciliation Form for a subsample of 80 percent of the households. For 
the remaining 20 percent, original responses are not transcribed for comparison in the 
field, and hence not reconciled with rointerview results. 
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(2) In the reinterview the following order of preference for the selection 
of respondent is specified. The person for whom the information is being obtained 
is the first choice, if available, for reinterview. Second choice is the original respondent 
if that person was acceptable according to the rules. Third choice is another respon¬ 
dent meeting acceptability standards. Of course, a difference in respondents may 
result in variation in results. 

(•*) The reinterview is initiated by a personal visit to the household. The 
itinerary of the reinterviewer is planned to maximize the completion of as many re- 
interviews as possible by personal visit. For households not at home on the first 
reinterview visit, a callback by telephone is permitted if the household has previously 
agreed to interview by telephone. 

(4) In general, reinterview covers all questions relating to work status as well 
as other questions, originally included in the first interview, as indicated in the special 
monthly instructions. Entries aro made on a regular blank CPS form for the month 
and changes are not to be made after this part of the reinterview ends. 

(•’>) "Reconciliation" follows in the random subsamplc of the 80 percent of 
the households for which reconciliation forms have been provided. For these reinter¬ 
view households, res|H»nses obtained in reinterview are compared with those obtained 
in original enumeration, and where differences apparently exist, the determination is 
made whether the responses meet the definitions of equivalence. If not, an effort 
is made, with the help of the respondent, to decide upon the more accurate iespouse 
and to ascertain possible reasons for the difference. 

The division of the sample into the "reconciled'’ and "unreconciled” groups 
provides the basis for Table 3 below. 

The table shows the very large impact of "reconciliation" on the gross- 
difference rates and a smaller but measurable impact on the net-difference rates. 

TABLL 3. OK088- AND NET-D1FFERENCE RATES, CPS OKIOINAL AND RKINTEKVIEW 
SURVEYS s DIFFERENCES NOT RECONCILED (20 PERCENT OK REINTER VIEW 
SAMPLE); DIFFERENCES AFTER RECONCILIATION (80 PERCENT OF REINTER¬ 
VIEW SAMPLE). AVERAGE OF CPS RESULTS, 1058-1001 


(percent) 


•mployniont statu* 


labour fore** 
employed 
agriculture 
nonagriculture 
Tull time 
purl, time 
with u job 
unemployed 
not in labour force 


average gross-difference niton 


average net*difference rates 


i Original 


20 percent 

of sample- 
differences 
unreconciled* 

80 percent 
of sample, 
after recon¬ 
ciliation 3 

20 percent 
of sample- 
differences 
unreconciled * 

80 percent 

of sample- 

aftor recon¬ 
ciliation 3 

4.1 

1 .6 

.26 

.62 

3.0 

1 .4 

.18 

.47 

1.2 

.4 

.04 

.10 

3.5 

1.4 

.1 

.37 

4.4 

1 .6 

.2 

-.24 

4.6 

1 .7 

.1 

.61 

1.4 

.5 

-.1 

.01 

1 .9 

.8 

.1 

.15 

4.1 

1 .6 

— .26 

-.62 

►I'tho Census, 1963. 
Ial»le to re interviewer. 

3 Original survey data available to 

reii.torviowor. 
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For the labour force survey the evidence is that the reconciliation process has 
cut the reconciled gross-difference rate to about 40 percent of the unreconciled gross- 
difference rate. 

The effect of the between-trial covariance of response deviations on the gross- 
difference rate. The results of the CPS Reinterview Programme make it possible to 
estimate at least the order of magnitude of the between-trial covariance of response 
deviations for identical persons. This in turn permits us to gauge the effect of 
these covariances on the gross-difference rates. 

We shall consider the two gross-difference rates : 

( 7 , : estimated from original CPS responses compared with unreconciled 
reinterviow responses. 

g 2 : estimated from original CPS responses compared with reconciled re¬ 
interview responses. 

We can write : 

E(g t ) — E 0 -\-P t y—2B(Xj t ffXj t > t /) ••• (22a) 

Adding and subtracting the means P c and P tl - and setting » I— P 0 and 
Qo' “ I —Po"' we have : 

WVt) - P<tio+PQ'Q*-mx it g’-P i9 '){x H . 0 .-P i0 ') 

-2 E(P ia -P 0 )(P ia ,~P 0 .)+{P 0 ^P a ^. ••• (53) 

And. noting that E(x il0 —Pj U )( x j,'a'^Pjo') — P 40 .do'O da^do'- tile between- 
trial covariance of response deviations : 

Pdo. •ni' <T 4o fr 40' = oQo+PfrQc'+U’a-- p u') z —E[g t )) 

-E{P ia -P 0 )(P iU '-P 0 .). ... (64) 

We shall assume that the reconciled reinterviews produced a gross-difference 
rate, g 2 , reflecting an improved procedure, O'. 

Thus, the generalization of Theorem 3 holds : 

EiPio-PoHPia—Pa.) > ^+(.5 -P a W*-Po). ... (46a) 

And, since the definition of the response variance in (17) gives : 

a *)o = P oQ 0 - 0*4 v ... (17a) 

Then, simplifying terms and writing the covariance : 

p40.40'04o0 40 ‘<a^ a —\E(g 2 ). ' ... ( 66 ) 

The unreconciled gross-difference rate. g t . arose from what was essentially an 
independent replication of the original procedure. Consequently, using (25), we 
can obtain an estimate of rrl a from g, -. 



(*tt) 


Hence we can write an npper bound for the between-trial covariance among 
response deviations in a form from which we can obtain estimates : 


17 


Pdo. do , Od(PdG , < i#(;7,--9,). 


(57) 
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Estimates of the upper bounds of the between-trial covariances for labour- 
force categories are shown in Table 4. based on comparisons of the reconciled 
reinterview data and the original CPS data. 


TABLE 4. ESTIMATES OF THE UPPER BOUNDS OK THE BETWEEN-TRIAL COVARIANCE 
AMONG RESPONSE DEVIATIONS FOR LABOUR-FORCE CLASSIFICATIONS: 

CPS ORIGINAL AND REINTERVIEW SURVEYS 


labour-force 

category 

average estimated gross- 
difference rates 

ostimated 

simple 

_ iPstMinsr 

estimated 

upper 

bound of 

covariance, 

reconciled 

sample 1 

ratio of 
estimators* 
(e)-r(d) 

unreconciled 
sample. «/, 

reconciled 
sample, j/,« 

variance. 

unreconciled 

sample: 

(a) 

(b) 

(0) 

(d) 

<«> 

(0 

labour force 

.041 

.010 

.020ft 

.0125 

.01 

employed 

.030 

.014 

.019ft 

.0126 

.04 

agriculture 

.012 

.004 

.000 

.0040 

.07 

nonagriculture 

.033 

.014 

.017ft 

.0105 

.00 

full timo 

.044 

.015 

.022 

.0145 

.00 

purl time 

.040 

.017 

.023 

.0145 

.03 

with a job 

.014 

.00ft 

.007 

.0046 

.04 

unemployed 

.010 

.008 

.0095 

.0055 

.58 

not in labour force 

.041 

.010 

.0203 

.0125 

.01 

Source : U. 

S. Bureau of the Census. 1003. 





t Difference* after reconciliation. * estimated by 

1 U PP" b ° un<l ,,f "*■ *”*> "to- , UppM bound of 

estimated by (Kgi—9a))- * 

estimated by —— I — 

f/i f71 


Column (f) of Table 4 provides ratios that assess the effect of reconciliation 
on the gross-difference rate. Estimates of twice the upper bounds of the between- 
trial covariances are used in the numerators because those aro the quantities that 
are the subtractive terms in the gross-difference rates. |See (31)]. The denominators 
are the estimated unreconciled gross-difference rates. The reductions shown in column 
(f) aro substantial. However, we have not found a useful estimator of the lower bounds 
of the between-trial covariances. If we can assume that the upper bounds approxi¬ 
mate the actual between-trial covariances, as may be reasonable under many circums¬ 
tances, the above results suggest an improved method of collecting certain types ot 
labour-force data, as discussed below. 


The repetitive nature of the CPS offers the possibility of estimating total 
change in employment status of identical individuals from month-to-month m the 
same manner that gro» differed are estimated from a re.nterv.ew survey Average 
rates of month-to-month total changes for klent.cal md.v.duals arc show, m Table ■ 
;.!r two categories, “in labour force ' and "unemployed." The comparable monthly 
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gross-difforoncc rates, representing differences between the or, S ,nal and th ° 

unreconciled reinterview for the identical month, are shown in I able o. 

TABLE 5. AVERAGE MONTH-TO-MONTH RATES OP 0P * 

CLASSIFICATIONS "IN LABOUR FORCE” AND "UNEMII M 
IDENTICAL INDIVIDUALS— 1958-OCTOBER. 1062 


(percent) 

labour-force 
category 

average 

average rate* of change 

TOR 

f> 

proportion 

into cla**‘ out of da-* TCR* 

'iu 

in labour force 

57.3 

2.8 29 67 

9.9 

unemployed 

3.5 

1.5 1.7 

91 .4 


Sourer : U.S. Bureau of the Conaui. 1963 

.Average number of peraona entering claaa.fical.on cupmaard as a percent of 
all poraona in the CPS sample in two auccoaaive month.. 

-’TCR** Total Change Rate. The percentage in thia column represent* the -urn of 
corresponding percentage, in the preceding two column*, yielding a rate of change 
taking into account movement into and out of the da**. Note that the true "groM- 
change rate” .wed in aubaaquent di»cu**ion reflect* only movement* into the da»». 

TABLE 0. AVERAGE RATES OK DIFFERENCES RESULTING FROM 
CHANGES INTO AND OUT OF LABOUR FORCE” AND •UNEMPLOYED- 
CLASSIFICATIONS. CPS ORIGINAL AND REINTERVIEW 
RESULTS. 1 •66-1961 


(percent) 

Inbour.forre 

category 

proportion 
in claa$: • 

average monthly difference rate* 


into da** out of c 1 a*» 

groan- 
difference 
rate (p) 

9 

in labour force 

55.9 

2.2 1.9 

4.1 

7.4 

unemployed 

3.4 

1.0 0.9 

i.n 

56.8 


Source : U. 8. Bureau of the Cenaua. 1963. 


i p, — . *0 r Q’ where P, 0 — proportion in claaa in original aurvey and 
* ™ proportion in daa* in rvinterview aurvey. 


The gross-difforence rates reflect response differences between two interviews relating 
to the samo survey wcok in a given month while the total change rates refer to the 
measurement of changes in status from the survey week of one month to the survey 
week in the following month. For the classification of “Unemployed.” the average 
monthly gross-difference rato was 57 percent compared with an average month-to- 
month total change rate of 91 percent. For the classification “In tho Labour Force,” 
the comparable percentages are 7 percent versus 10 percent. 

The data seem to support the notion that month-to-month total gross changes 
are overstated and perhaps significantly so as a result of response variability. The 
possible large reductions in the gross-difference rates by the introduction of recon¬ 
ciliation, i.e., a dependent procedure, as shown in Table 4 suggest the possibility of 
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replacing the present system in the CPS of independent interviews each month by a 
system which permits the interviewer to take account of the results obtained in the 
previous month s interview. The resulting emphasis on change in status each month 
may have the effect of substantially reducing the response variance in gross and net 
inonth-to-month changes. There is. of course, the danger in this approach of intro¬ 
ducing temptations for the interviewers to merely copy the previous month's status. 
Research is needed to determine whether this possibility offsets the potential advan¬ 
tages of the introduction of a dependent procedure. Such research is now under wav 
at the Bureau of the Census. 

(C) Study of the reliability of coding of occupation and industry in the 1960 
Census. This discussion is based on a paper by Fastcau. Ingram, and Mills (1962). 
In this study, independence between trials was achieved. There were no correlations 
between response deviations for identical elements on successive trials. Also, differ¬ 
ences in expected values can be regarded as of little consequence. The measurements 
obtained can thus be used as reflecting the precision of a single procedure—the proce¬ 
dure for coding occupation and industry in the I960 Census. 

The data used for this study are largely a by-product of the quality-control 
scheme used in the 1960 Census. In controlling the quality of industry and occupation 
coding in the 1960 Census, there was a selection of a I in 40 sample of households from 
the 2f> percent Census sample for whom occupation and industry data were collected. 
Persons in the experienced civilian labour force falling into the I in 40 sample 
households were coded independently by three different clerks having approximately 
the same training and coding experience. All three of these coders coded from the 
Census Schedule, but only the third and last coder entered his code on the Census 
Schedule. This coder is referred to below as the “Census Coder." The coded results 
were then matched against one another and placed for verification purposes into one 
of the following four categories : 

(1) All three agreed on the code (category AAA). 

(2) Two agreed on a code and one disagreed (category AAB). 

(3) Two agreed to refer the item and one cotied it (category RRA). 

(4) All three disagreed (category ABC). 

The sample for this study includes one-fourth of the AAA cases and all cases 
of disagreement of any kind occurring in the I in 40 sample. 

The measure developed for scaling the codes in terms of degree of inconsistency 
in application is. in expected value, almost identical to l Uo defined in Section 4. 
It answers the question, “Given a cotie. how consistently was it independently applied 
by three different cotiers looking'at the same verbal description?" 

The Index takes the operational form : 
y . 32Vaaa + a h 

3iV AA a 4- 2iV A ab + fi h+^A fie) 
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where 

iV AAA = the number of cases for which all three coders applied the codo under 
consideration. 

Huh = the number of cases for which any two of the coolers applied the code 
under consideration and the third applied some other code, 

.V A r,-, = the number of eases for which only one coder applied tho code under 
consideration and the other two coders Agreed upon some other code. 

zVjbc = the number of cases in which all three coders disagreed hut one of 
them applied the code under consideration. 

In some instances a coding clerk concluded that the information on tho ques¬ 
tionnaire was not sufficient to assign a specific code, and the clork was instructed to 
refer the case to an expert for a decision. A referral action is hero treated as a bona- 
fide code. 

Tho index of inconsistency serves as a useful device in pointing out those codes 
which may have low reliability because of inadequate descriptions or because of con¬ 
fusion on the part of the coder as to what code to assign for a given description. 

Indexes of inconsistency. Tabic 7 gives the distributions of the 149 industry 
codes and 29(1 occupation codes by size of the inconsistency index. A substantially 
larger proportion of occupation codes have low indexes of inconsistency than do 
industry codes. Forty-eight percent of the occupation codes as compared with 39 
percent of the industry codes had indexes between .001 and .100. For both types 
of coding, the .001 to .100 class accounted for about 74 percent of the experienced 
civilian labour force. 


TABLE 7. NUMBER OF INDUSTRY AND OCCUPATION CODES BY 
INDEX OF INCONSISTENCY 


index of 
inconsistency 


industry codes 



occupation codes 

number of 
codes 

percent of 
codes 

estimated 
percent of 
labour force* 

number of 
codes 

percent of 
codes 

estimated 
percent of 
labour force * 

.001 —.100 

59 

39.3 

.73.6 

142 

48.0 

74.4 

.101—.200 

56 

37.3 

18.8 

93 

31.4 

22.6 

.201—300 

23 

15.3 

6.6 

41 

18.9 

2.6 

.301—.400 

6 

4.1 

0.8 

II 

3.7 

0.2 

.401 —.300 

2 

1.3 

0.1 

4 

1.3 

0.3 

more than .300 4 

2.7 

0.1 

5 

1.7 

— • 

total codes* 

150 

100.0 

100.0 

296* 

100.0 

100.0 

Source: Fasteuu, 

Ingram and Mills (1962). 






« Includes the code* for "not reported '. * Estimates based on a sample of 420.000. 

s Excludes Code 000 "Accountants and auditors" « Ix-*s than .05 percent, 

because of programming error. 


This information on coding variances will be useful, along with information on 
other components of measurement error in the 1960 Censuses, in guiding future im¬ 
provements in census methods. 
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A further study was made of the 20 percent or so codes having the highest 
indexes, '['he cutoff point for both industry and occupation codes is at Index .20. 
(The fact that the two above numbers are the same is only coincidental.) A particularly 
interesting outcome was that every industry code for wholesale trade (Codes 606-629) 
was above Index .20 as shown in Table 8. 


TABLE 8. LIST OP WHOLESALE TRADE CODES AND ESTIMATED INDEXES 

OK INCONSISTENCY 



description 

number of cases in sample 

index 

coat* 

AAA 

other 

000 

motor vehicle* and equipment 

100 

423 

.225 

007 

drug*, chemicals and allied produces 

87 

340 

.226 

OOR 

dry goods and apparel 

74 

320 

.240 

009 

food and related products 

479 

1.025 

.202 

010 

farm products — raw materials 

80 

472 

.275 

017 

electrical goods, hardware, and plumbing 
equipment 

208 

705 

.202 

018 

machinery, equipment and supplies 

137 

1,049 

. 339 

019 

pet roleum products 

III 

054 

.290 

020 

miscellaneous wholesale trade 

552 

1.895 

. 205 

029 

not specified wholesale trade 

08 

583 

.358 


Source : Fasteau. Ingmm and Mill* (19112). 


Information of the type shown in Table 8 will aid in designing better code 
structures and bettor procedures for the next census. It will also aid in interpreting 
the present census results. 


6 . Discussion of statistical engineering implications of simple 

RESPONSE VARIANCE 


The review in the previous sections indicates to us that : 

(a) Measurements of gross error (or gross difference) can bo used with some 
effectiveness in both the design and control of surveys. 

(b) Despite the apparent simplicity of the concepts of “simple response 
variance,” of “gross-difference rate” and of "index of inconsistency," a great deal more 
in the way of theoretical and experimental work has to be done before these concepts 
can be fully exploited. We have identified six problem areas in which further research 


is needed. 

(1) Is a given process of classification as carried out in a particular survey 
in control ? 

The methods of reinterview or evaluation that have been used up to now 
provide useful information on this question. There are, however, a number of .mpor- 
tant unresolved issues. 

(a) A minimum attainable value for an index of inconsistency for an .tern 
would be the lowest value that could be obtained by the best procedurethatcanbe 
devised for that item. For example, it may turn out that no acceptable procedur 
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that we can devise for determining whether or not a person is unempiloyod woul1 P 

duco an index lower than .2. This can provide a standard for evaluating other 
However, the final test of a method is that the measurements be adequate to serve 
uses for which the measurements are made. Work is needed to establish the accept¬ 
ability of different levels of the index of inconsistency for different purposes, 
question is discussed further under point 3 below. 

(b) Theoretical work is needed to separate more sharply the sampling an.l 
response variance components of the gross-difference rate and to determine the ettec 
of correlations between response deviations when the expected values of t le in i' u ua 
responses are different as between the survey and the repetition of the survey. 

(c) Experimental work is needed to develop survey devices for obtaining better 
estimates of individual expected values, of the correlations between response devia¬ 
tions on successive trials, and of the correlations between individual expected values 
under different procedures and conditions. 

(2) Is the method of evaluating a classification process in a given survey in 


control ? 

The Bureau of the Census relies extensively on reinterview, sometimes sup¬ 
plemented by interpenetrated samples, for control of the work of inter viewers. As 
pointed out above, the results in the CPS indicato that the reconciliation process that 
wo have instituted gives rosults substantially different from the unreconciled reinter¬ 
view results. Further research is needed in ordor to understand tho reason for this and 
to understand bettor how to use rcinterviews for control purposes. 

(3) Is the characteristic under study sufficiently measurable to serve useful 
purposes when measured by the techniques available to us? 

Estimates of the index of inconsistency provide measures of tho degree of 
fuzziness of tho underlying classification system when the process is in other respects 
under control. We have done only a limited amount of investigation on how to use 
this index to pinpoint those components of tho economic and social classification 
systems that we use that need clarification or redefinition. 

(4) How do gross differences (gross errors) affect the measurement of gross 
change ? 

The review of our CPS reinterview results leaves us with tho uneasy feeling 
that the measurements of gross change may be adversely affoctod by gross differences. 
However, some independent data cited suggost that tho random processes operating 
in surveys may tend to cancel out for estimates of gross change. We are beginning 
to undertake some systematic research in this area. 


(5) In repeated surveys or censuses, how can we estimate the response variance 
for different survey procedures ? 

Not enough is known about this question, and data are difficult to obtain and 
to evaluate. The few comparisons presented in this report comparing the 1950 and 1960 
Censuses leave a great deal to be desired. For example, to what extent do the dif¬ 
ferences in tho index of inconsistency represent improvements in the quality in the 
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Censuses, and to what extent do they represent improvements in the quality of the 
evaluation surveys ? 

(6) lo what extent do gross differences obscure underlying relationships 
between characteristics ? 

I his is the problem of the attenuation of correlation between characteristics. 

Results bearing on simple response variances have been used by the Bureau of 
of the Census in the design and control of surveys and censuses. These results are 
useful, along with interpenetrating samples and other types of studies, in isolating 
the nature and sources of measurement errors in surveys. We believe that wo have 
barely begun to scratch the surface of their usefulness and that the next few years 
will see considerable development of the conceptual and practical tools needed to 
mako the use of measures of response variance more effective. 
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von MISES FUNCTIONALS AND MAXIMUM 
LIKELIHOOD ESTIMATION* 

By G. KALLIANPUR 
Michigan State University 


I. Introduction* 

In 11)55, C. R. Kuo and the author introduced a clu.ss of estimators of a para¬ 
meter 0 which were Fisher consistent (FC) and which as functionals of distribution 
functions, satisfied suitable regularity conditions such as Frdchot differentiability 
(Kallianpur and Kao, 1955). It was shown that any statistic belonging to this class 
is consistent and asymptotically normally distributed with asymptotic variance 
greater than or equal to [n «(0)]" 1 . where i(0) is Fisher s information function. 

In view of this result, R. A. Fisher's definition of efficiency (for a rccont dis¬ 
cussion of this and related concepts sec Kao, 1952) becomes meaningful or justifiable 
at least so far as the class of FC, Frtchet differentiable estimators is concerned. How¬ 
ever, such an approach can bo considered usoful or interesting provided this class is 
general enough and if it cun be shown that there are estimators belonging to this class 
that are efficient. In particular, it would be desirable to prove that the likelihood 
estimator is a member of this class (and hence efficient with respect to this class) 
Although, in a later paper Kao (1957) was able to show this to be the case when U 
is a parameter in a multinomial distribution, the question in general, remained un¬ 
answered in the joint paper by the author and Kao (1955). The authors of that paper 
were not able, under any reasonable set of assumptions (on the density function in the 
continuous and the probability function in the infinite discrete case), to prove the 
Frdchot differential|,ty of the ML estimator. Apparently, at the root of the difficulty 
;; the f aot that Frtchet differentiability is too severe a restriction when dealing 
with the infinite dimensional (i.e. non-multinomial) situation. 

In i this article we propoae to examine the problem afresh by ^placing Frcehot 
differentiability by a weaker analytical concept (which, consequently yields a wider 
class of cstmiators) that of Volterra (or V) differentiability (also called weak or 
O&teaux dillerentiabihty). the notion of F-differen.iable functionals was introduced 
nto statistical work by It. von Mises as early as 1948 (cf. von Mises, 1947) and was 

.. .. who - * 

We shall consider Fisher consistent, von Mises functionals of the second order 
whose precise definition is given in the next section. All the results corresponding to 
hose » Kallianpur and Rao (1955, wiU be derived also for estimator belonging to the 
class. But the man, concern of the paper will be to prove that under suitable 
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conditions, the ML estimator is a FC, von Mises functional of the second order. Thus 
the class of FC, von Mises functionals of the second order possesses desirable features 
mentioned earlier, which the class of FC, Fr6chet differentiable functionals, has not 
been shown to have. Although the conditions under which the F-differentiability 
and efficiency of the ML estimator are proved are more stringent than the conditions 
needed for showing its consistency and asymptotic normality, they are of the same 
general nature and apply to a reasonably wide class of distributions. Hence no attempt 
has been made to seek refinements in this direction. The interested reader will, no 
doubt, be able to improve upon them. 

Finally, the closing section offers some remarks on another concept of efficiency 
recently introduced by Rao (1962). 

-• von Mises functionals of the second okdek 

The following notation will be adhered to throughout what follows : 

(i) The parameter to bo estimated, 0, lies in an open interval / of the real line; 

(ii) F 0 stands for the common distribution function of the independent 
observations X lt .... X n when 0 is the “true” value of the parameter; 

(iii) P 0 is the infinite product measure determined by F g on the (infinite) 
product of the real line with itself, a generic point of the latter space being denoted 

by <*> — (*». •••)• 

(iv) For each n, and w = (x |t x t , ...), /’*(•, <a) denotes the empirical distri¬ 
bution function when the observed sample is given by (.r,, ...,*,,). 

The definition of a von Mises functional of the second order given below is a 
slight modification of the one adopted in a recent paper by Filippova (1962). 

Wo shall consider functionals T defined on a subset S T of the space of all distri¬ 
bution functions (d.f.'s). It will be assumed that F 0 belongs to S T for all 0 in /. A 
subset t t of S r is said to be starlike at F 0 if for every 1 Ver T and 1 1 [0, 1], the d.f. 
F 0 +t(W — F 0 ) er T . 

A functional T is tn times differcntiublo at F 0 in the Voltorra senso (orm times 
F-diffcrentiable) relative to r T , starlike at F 0 if for k = I.to. 

(a) T[F 9 +H\V—F 9 )] exists for every t in 10, 1 J and every W in r r , and 

(b) there exists a functional T lk, [F 0 \x lt ...,x*J depending on F 0 and k real 
variables ar lt ..., x k such that for every Wer T , (writing h = IK F 0 ) 

d ^ k T\F g +th] mo = /.../ T tk '[F 0 \ . x k ) dh(x x ) ~dh(x k ). 

Here, as in the sequel, all integrations are over the entire domain of definition 

of the variables. The functional T*>[F 0 ; x t . x k ] is assumed to be a Borel function 

of (* t , ..., .r,) and is called the *-th F-derivative of T at F 0 . 

We arc now in a position to introduce our basic definition. 
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Definition 1 : T is a von Miscs functional of the second ardor at F 0 if the 
following three conditions are fulfilled : 

(i) There exists a set t t (0) starlike at F 0 such that 

lim P fl (w : F' n (-, o>)€t t {0)) = I; 

00 

(ii) T is twice F-differentiable at F 0 relative to r T [0) ; 

(iii) for every t > 0 , 

lim PJ(<o : n»d„(<u) > t} = 0, 

wher ® <*.(«) = sup i £ T|a-, <■>)] | . 

i at* 

w. <*>) - 

and P# is the outer measure corresponding to P 0 . 

Condition (iii) of the definition is stated in terms of outer moasuro since this is 
all that is needed for our purpose and to avoid any discussion of the measurability 
d n {o>). Observe that rf„(a>) is assumed and defined only for to in the sot M n T — (to : F n 
(•, to)er T (0)) so that the set displayed in (ii) is necessarily a subset of M n%T . Although 
T{F „(•, <o)J is defined only for toeJ/„ <r its definition can be formally completed for all 
to in many ways (for instance, by setting it equal to a constant when to 4 M HtT . Since 
tends to zero, the values of T[F m (- t to)] on M m T do not in any way affect 
tho asymptotic results in which we are interested. It will he assumed that the 
T[F „(•, to)) thus obtained is. for each n, a measurable to -function. 

(iv) If F 0 + n tTfiO) for all y sufficiently small (0 being the true value of tho 
parameter) then 


The conditions to l>e imposed on F„ will ensure that the first part of (iv) is always 
fulfilled so that essentially (iv) will be a restriction on tho functional T. 

Wo shall suppose that the random variables have a common probability density 
/(*, 0) with respect to some fixed <r-finit® measure A. The regularity conditions under 
wh.eh our results will be obtained are naturally stronger than those needed to prove 
only consistency and asymptotic normality. Tho following assumptions will bo 
assumed to hold throughout the rest of this paper. 

(A) These are essentially the conditions assumed by Cramir (1986). For every 
x except at most on a set of A measure sere, the derivatives S> '°* f ({ = 1 , 2 , 3) 


exist for every 0 in /. For any 0 . j| % < O, where 0. are integrate with respect 


to A over (-co, co). while < // for all 0 in / 

independent of 0 . 


where E e H < K < oo, K being 



< co. 
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(B) Lot a 0 (x, 0) = log f(x, 0), a&x, 0) = — — (» = 1, 2)and 7.(0) = 

(i) For each 0 in / there exists a neighbourhood N oi 0 such that EAa { (X t 0 )] 
(* = 0, 1,2) exists for 0'e N. 

(ii) For i = 1,2, EJaJ(X t 0)] < co and E 0 H Z < oo for each 0 in /. 

(iii) F °r ©very 0 in /, the functions g,(x, 0) = ( tjf(x , 0))~*[f(x, 0+y) —f(x, 0 )] 2 
(/; being positive and tending to zero) are uniformly intcgrable with respect to F 0 . 

Conditions (ii) and (iii) of (B) are somewhat stronger than are actually needed 
in the proof of the results. A consequence of (ii) and (iii) is that the functions 

0)] 0 = 1.2,) are continuous functions of O' in N, differentiable with respect 
to O' at O' = 0 with derivative equal to E 0 [a t (X, 0) a x (X, 0)]. 

We recall that a functional T is Fisher consistent if T[F 0 ] = 0 for all 0 in /. 

Now if T is any FC, von Mises functional of the second order (wo shall omit 
the phrase “at F 0 ”), it is oasy to verify that 

n'\{T[F n (-, w )]-0}-n» / T">[F 9 -, x) d[F n {•, c*)-F 0 ]\ 

< n*d„(o>) c (o>)+ 5*(<*>). 

*.t 

where c %f is the characteristic function of M„ T and converges to zero in 

probability. From condition (iii) of Definition 1. it follows that the random variable 
on the loft side of the above inequality converges to zero in probability. From this, 
and a well known result of Khinchin (sec Kallianpur and Rao, 1955) on the normal 
convorgenco of sums of independent, identically distributed random variables we 
immediately have our first result. 

Theorem 1 : If T is a FC, von Mises functional of the. second order, then 
n*[T[F n )— 0) is asymptotically normally distributed if and only if / (T ,,, [F (? ; a-]) 2 dF 0 {x) 
is finite. 

Theorem 1 is the analogue of Theorem 3 of Kallianpur and Rao (1955) stated 
there for Frcchct differentiable FC functionals. Let be the class of all measurable, 
FC, von Mises functionals of the second order for which f (T n, fF 0 ^; x])* dF 0 (x) is finito. 

By imposing suitable regularity conditions on F 0 a lower bound for the asymptotic 
variance of Tc^fl will bo obtained, as in Kallianpur and Rao (1955), which coincides 
with the bound given by Fisher. 

3. The maximum likelihood functional and its properties 

Now let 0 0 denote the unknown true value of 0 and for S a sufficiently small 
number to bo specified later let U, be the open interval (0„-S. 0,+S) whose closure 
(f? s ) is contained in /. Let A.(«„) be the set of all distribution functions W satisfying 
the following conditions : 

(i) The integrals lafx,0)dW (. = 0,1,2) exist and are continuous 
functions of 0 in U„ ; 

(ii) 


| fa^x, 0 Q )dW\ < «* 2 , W*. 0 o )dW <-§* 2 
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whore wo write 

fc* = \{—^)\ • a " d < 2K - 

The set A* ( 0 o ) is clearly non-empty since it contains F 9% . In view of conditions (B) 
it is easily scon that F $ belongs to A A (0 0 ) for all 0 in some N(0 0 ). This fact will be 
used later. Now define S A (0 9 ) to be the set of all distributions 1'“' = — F oJ> 

whore IFeA A (0 o ) and 0 < / < I. It is easy to verify that S A {0 9 ) is sUrlike at F 0q . F«>r 
any V in .S A (0 O ), 0(0, V) = J a 0 (x, 0)dV exists and defines, for every 0 in 0*, a functional 
over S 6 (0 0 ). By the definition of A*(0 O ), 0'(0. V) (primes denote differentiations with 
respect to 0) exists and is given by /a,(r, OyiV which is continuous in Taking 
V = V, and applying the finite Taylor expansion to 0'(0. V tn ) wo write 

0'<*. v m ) - m. v u> )+{ 0 - 0 0 ) I a+x, 0 o )dF“»+M0-0o> 1 mv* 

wm-kty-ej+Af. ... (3.1) 

where \fi\ < 1 and \ A,\ < 0*(2/( + 1)+ \k*S. From this it is easy to see that <j*'{0 o —A, 
F<”) > 0 and 0'(0 O +*. F“») < 0 provided 0 < A < ***<3A+l)-». Since 0'(0, F“») 
is continuous in 0 A , it follows that for each l"" in S*(0 O ) the equation 0'(0, F“') = 0 
has a root in I/*. This root, which wc shall denote by 5( V m ] % is a funct ion or functional 
of V Ui and is defined on S A (0 O ). Furthermore, again utilizing the definition of A* (0 O ) 
and V m t we have V m )) < — \k* + 4KA < 0 for all 0 in f/*, A being chosen such 
that 0 < A < min {$fc*(3/f+1)“*, i/WT** 1 }. It follows that 5(1'“'] is the unique root of 
the equation 0'(0, F“') = 0 in U A as also the unique maximum of 0(0 1'“') in U h . 

Essentially the same argument as Cramer's (1946) consistency proof shows 
that the P 0 *-probability that F* (•, <o) lielongs to A* (0 O ) tends to one as n—*co and 
hence that for all t in (0, 1]F, # («: FH\-, u)«£«(0 o )]-»l. Observe that whenever 

^w(*» to)e St(0 Q ), the likelihood function of the sample coincides on l/* with the function 
0(0, F*). It follows that the unique root of the likelihood equation lying in U A for 
which the likelihood is a local maximum (the existence of such a root is a consequence 
of a combination of arguments of Cramer (1946) and Huzurbazar (1948) and need not 
be ropoated here) is indeed given by 5(F;(-, w)] where 5 is the functional defined above. 
Wo shall refer to 5 as the maximum likelihood functional (MLF) although, as is well 
known, 5(F;(-, o>)] does not necessarily make the likelihood an absolute maximum. 
In accordance with the notation of the preceding section we shall write tJ 0 o ) instead 

of SM. * 

1 he proof that the MLF 6 is a von Mises functional of the second order consists 
of two parts. First we show its Fisher consistency and derive some of its analytical 
properties regarded as a functional defined on r«(0 o ). 

The “? m 2 m , The ML f unciimal 6 >'« FC and is twice V-differentiable relative 
to the set 7. (0 O ). The first and second order V-derivatives of 5 at F 0 are given by 

i-* O ,(*,0o) and nr*a l {x l ,0 t )a^ H ,e t ) respectively. 
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Proof: Setting / = 0 and 0 = d in equation (3.1) 

we have = 0 . 

Since \8[F 8 J—O q \ < 6 the second factor on the right being less than — k*+KS cannot 
be zero so that 6[F 0O ] = 0 0 . This proves Fisher consistency. First wd show that 
fl ‘ ’] is a continuous function of / in [0, 1J. In subsequent arguments wo shall use 
the expression “for S sufficiently small*' to mean that S has been chosen loss than a 
fixed positive number S 0 which depends on ** and A’. That 6 can be so determined will 
bo apparent from the context. Now writing F w » = F $0 +th (/i = W—F 0Q ) t a t for 

a i(.r, 0 0 ) (» = 1, 2) and letting V be such that 0 < t+t' < 1 it follows from (3.1) after 
some simplification that 

1 6 [ F i, + , '»]— 0 [F w# »]| < |F|[| fa^lh f a l dV ,n — fa l dhfa 2 dV , ° | 

+ i( I fax'* V m f Hdh | + J \Hd F‘” / a x dh |)) 

x [(*”-(<i<5( | \HdV “> +CJHdh |)) 

X | f//d F«> I )—i\fa x dV"> f Hd F«> | ]-* 

the quantity on the right side being positive for 6 sufficiently small, and tending to zero 
as 0. The assertion is thus proved. Again from (3.1) we have 
t‘-'{0[ F«+''»]-0[< »JJ = [ /«,</ VMJaJh - JaJhfaJ F«» 

+ MMl+nSaidVnSHdh-\ft£W)la x dhlHd V'"] 
x ({a«cf F<”+ rsajh ++f'H J//d V'"+t'iH dh) 
x J/?A(0/«rfF«»}- J/?/a,dF«»///dF«'»], 

where A(<) = 6\ V ,ll ]—0 0 . Since A(/) has been shown to bo continuous it follows 
making >0 that 0[F M »] is differentiable with respect to t and that 


on 


fL0r F M »1 = 

Jt 1 J W) 


d 

dl 


(3.2) 


where 

P{t) = F«'» - SnJhSaJ F«» + R<* F«'»J//c//i - RdAJ/M F“>) 

and 

R(t) = (Ja 2 r/F f »4-J/?A(/)/////F‘'»)*-^/fl |t /F«>///f/F“>. 

Since 0[F‘°] and hence A(f) is differentiable with respect, to /, so are P(() and R(t) and 

it follows from (3.2) that 5| F W) ] exists. We have (primes now denoting differen¬ 
tiations with respect to /) 


* Ar i/(oi = £«9_ W0 
1 J J?(/) /?*(/) ‘ 

Finally putting / = 0 in (3.2) and (3.3) we obtain 

and «[ = Z/Jt-Vhl*.. »o) <M*t. »o) <«<*.) <«(*.)- 

The proof of Theorem 2 is thus complete. 


(3.3) 
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It has already been shown above that P g (If.j)-* I as n—► co where 

M n $ is the set (co : F' n {-, co) e t^0 0 )). This is condition (i) of Definition 1 with T = 0. We 
turn now to the proof that condition (iii) of that definition holds for 0. For every 
positive 6 there is an integer w 0 (€, <5) such that the following holds: P^ (M mi y) > I — C 

if n > n 0 , and whenever for every fixed / in [ 0 , 1 ], co)J is the unique 

root of <$>'((), F (l >) = 0 which maximizes ${Q, FP) in The definition of 0 for all 
w can be completed in such a way that (•, co)J is, for each /, measurable -is a func¬ 
tion of < 0 . To prove (iii) it suffices to assume that n > « 0 and that co belongs to M „ g. 

Since co) e t§(U 0 ) it then follows from Theorem 2 that 0|F|,"(-. o>)l exists and is 

at * 

given by P n R n x P n R n R n i where P n and R n are the functions P and R given imme 
diately after formula (3.2) except that now h = /’•(-, «)—#’ #> . Henco it is to be noted 

that P n and R„ as well ns their derivatives with respect to t are functions of / and co. 
Let us write 


A * = /«.«//■; B n = laJFl' C n -iU dFl t 

<*>) “ <*>))— 0 o and A w (co) =» sup 1 A_(/, co)|. 

1 

io simplify the writing wo shall suppress co throughout the onsuing argument, but it 
will bo supposed that co c M m j, and that all sou considere<l arc co-sots. Clearly A„ < S 
and furthor from (3.1) (writing A„(f) for A„(f, co)), 


Henco 


A .< -**«]-> - 5 ., say. 


(3.4) 


Clearly 5. converges to zero in probability by Slutsky's theorem since by the law of 
large numbors A, and B n +k* both converge to zero in probability and since S is suffi- 
ciently small. Honce for evory i' > 0, we have 


^.k*. > on n..i) < p,a. > 

Now, from the expressions for /'.(() and fi.(t) we have for any I in [0, I] 


(3.5) 


while 


1 *■(')' > [k '~ l*.+**l-JA.{C.+ j 

> (t*-|B.+t*|-2KJ)»-2X|4 > | = say, 

Ill'll < M.|[l=+«]. 


Henco 


sup 
o* r< i 


BjUfr' < M.ll »+x*]p;'. 


... (3.6; 
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We then have for y (here and in the sequel y is a positive number less than i) 

p S.([ B '- Y 0 “ u ,'i, | >£ 'l n "-») < > e'] 

which tends to zero as w-> oo again by Slutsky’s theorem since p„-» (k 2 —'2K8) 2 (>0) 
in probability and n* A n has an asymptotic normal distribution. Finally since 


d 2 

sup |--- 


06Ii4i 


0 [W] < SUp 

0<l< 1 


P&) 

PM 


+ sup 

I 


PM PM 
PM PM 


we have 


+/*;„ {(»• -p £[;} • g> | > i } 


(3.7) 


It is easily seen that 


PM—(±fiA.iH d F,'). P M y 


From this wo obtain sup|P;(<)| < /fj/ljsup . 


Hence 


”‘ sup -Tt\W < ■ K( “ Y| ‘ 4 "I^ 


lp.-)(n-eup Jg-|) 


from which it follows that the first term of tho right sido of inequality (3.7) tends to 
zero. Using (3.5) we obtain after straightforward calculations that 

sup I £81 < [ 2(t '+1 B ' +ki i + 3 *w (i b .+* i i 

+ 2X5.+3Xsup|-^-|^ +5*M.|] p-'. 

Since n t \B n + k*\ t n y % n and n y \A n \ converge to zero in probability (0 < y < J) it 
follows from the above inequality and (3.7) that 


5. [(*’ 


sup I 


mo 

JUT) 




for overy s' > 0. 
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The second term on the right side of (3.7) is not greater than 

*i .[(-* su p:- fg-■>vi r )n"-.jJ »p £g- >? )n"-.s] • 

Since both terms in the above expressU n approach zero as n —>co it follows that the 
quantity on the left side of inequality (3 ) tends to zero as it—too. 

This completes the proof that 9 satisfies condition (iii) of Definition I. Tin* 
verification of condition <iv) follows without difficulty from (B). Since condit ion 
(i) has already been shown to hold these facts combined with Theorem 2 give us our 
main result concerning 6. 

Theorem 3 : The ML functional 9 is a cun Mist* Junctional of the second order. 

4. Efficiency ok 0 relative to the class 
Now that 9 has been shown to belong to the class the next step is to show 
that it is efficient relative to This follows as u consequence of the next result which 
gives a lower bound to the asymptotic variance of estimators belonging to ^ ft . 

Theorem 4 : Let conditions (A) anti (B) be assumed to hold. If T is an esti¬ 
mator belonging to */t(, then 

i tT°vt, ■ *]>■ «■*«) > K( ^ 9 m j y. r • - <*■»> 

Proof: From the finite Taylor expansion formula and Fisher consistency 
of T we obtain the relation 

I - / ; x] lv/(x, »,)]-•[/<*. 0 0 + V ) 

-/<*• 0.)}iF,J,x) +V'( i‘ r\F +,h) ) . 

where g is sufficiently small, 0 < l( V ) < 1 and A = F^-F^. From Condition (B) 
and Condition (iv) of Definition 1 we have on making g —* ft 

i = ... ,4.2, 

The conclusion of the theorem follows immediately on applying Schwarz s inequality 
to the integral on the right hand side of (4.2). 

It seems appropriate at this stage to comment on a definition of efficiency 
recently introduced by Rao (1962). According to this definition an estimator is said 
to be efficient if its asymptotic correlation with the derivative of the log likelihood 
is unity. It follows from (4.2) that a statistic Te^fC is efficient in the new sense if and 
only if its asymptotic variance is equal to [n «(0)]-», i.e., if and only if equality holds 
19 
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in (4.1). Hence the now concept of efficiency and efficiency in the sense of Fisher are 
equivalent so far as the class is concerned. 

The results obtained in this paper can bo extended to the case when the para¬ 
meter 0 belongs to an open subset of &-dimensional Euclidean space. Finally, we 
offer a remark in connection with the definition of von Miscs functionals of second 
order. Condition (iii) is very similar to the one imposed in the paper by Filippova (1962) 
where asymptotic distributions of second and higher order functionals are studied 
in a different context. Condition (iv) can. if desired, be replaced by a suitable analyti¬ 
cal condition on T. For instance, (iv) is satisfied if it is assumed that the second 
E-derivative, x t , x+) at V l ( V in eT T (0)) is bounded uniformly with respect to 

V ut , a-, and x r However, such a sufficient condition would entail additional restric¬ 
tions on F Q if it is to hold for T = 9. 
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Summary. 

As balanced asymmetrical factorial designs require a large number of repli¬ 
cations, partially balanced asymmetrical factorial (PBAF) designs have been introduced 
by Kishcn and Tvagi ( 10 HI) which bring about a marked reduction in the number 
of replications and are thus of considerable practical utility in experimental investi¬ 
gations. This paper is restricted to the consideration of only PBAF designs of the typos 
qy 2* and 7 x 3* and it has been shown that PBAF designs of order m of both these 
types are readily derivable from the associated PBIB designs with m associate classes. 
The method of construction of these designs has been illustrated by obtaining the 
6 x 2 *. 4x3 s and 0x3* PBAF designs of the second order from the associated (il) 
designs and also the trivial group divisible (CJD) designs. Lists of useful 7 x 2 * and 
7 X 3 * PBAF designs of the second order have also been presented. Finally. PBAF 
designs of the second order derivable by iim. of pseudo-factors have been considoied. 

1. Introduction 

Kishcn and Srivastava (19.10a. 10.10b) have given general methods of cons¬ 
truction of asymmetrical factorial designs and Kishcn (I960) has discussed the method 
of constructing optimum designs of the class 7 x 2 *. Kishcn and Tvagi (1961) have 
given some further optimum balanced designs of the class 7 x 2 * and discussed various 
methods of constructing different tyjx-s of balanced asymmetrical factorial designs. 
They have also introduced partially balanced asymmetrical factorial designs and given 
some methods of constructing them. 

The balanced asymmetrical factorial designs discussed in these papers usually 
involve a large number of replications that are sometimes difficult of adoption by 
experimenters. The partially balanced asymmetrical factorial (PBAF) designs intro¬ 
duced by Kishen and Tyagi (1961) and discussed in detail in this paper achieve this 
reduction in the number of replications and are thus of greater practical utility in 
experimental investigations than balanced asymmetrical factorial designs. In this 
paper, only partially balanced asymmetrical factorial designs of the types 7 x 2 * and 
7 X 3 * associated to partially balanced incomplete block (PBIB) designs and those 
derivable by uso of pseudo-factors have been discussed, leaving the considera¬ 
tion of other partially balanced asymmetrical factorial designs to a subsequent 
communication. 
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-• BALANCED and partially balanced asymmetrical factorial designs 

2 . 1 . Definition*: An asymmetrical factorial design, in incomplete blocks, 
partially confounding certain degrees of freedom (d.f.) would be said to be balanced if 

(i) each treatment combination is replicated an equal number of times; 

(ii) each block is of equal size; and 

(iii) the loss of information on each of the single d.f. belonging to a partially 
confounded main effect or interaction is equal. 

I he above conditions are satisfied by a largo class of designs discussed by Kishen 
and Srivnstnva (1959a, 1959b). Kishen (1960) and Kishen and Tyagi (1961). However, 
as these designs involve a larger number of replications than can conveniently be 
adopted by experimenters, it has been considered necessary to devise ways and moans of 
reducing the number of replications so as to render the resulting designs of practical 
utility. This reduction has been brought about by introducing the partially balanced 
asymmetrical factorial (PBAF) designs, methods of construction of which are discussed 
m this paper. This paper is. however, restricted to the consideration of partially 
balanced designs of the types 7 x 2 * and 7 x 8 *. the treatments being all combinations 
«»f t hree factors A, B and C, A being at 7 levels and B and C being at 2 or 3 levels each, 
and the interaction BC and ABC being partially confounded. Such a design would 
be said to be a PBAF design of order m{m < 7 ) if the following four conditions are 
satisfied : 

(i) each treatment combination is replicated an equal number of times: 

(ii) each block is of equal size : 

(iii) the loss of information on each of the single d.f. belonging to the partially 
confounded first order interaction BC is equal: and 

(iv) the losses of information on orthogonal unitary components of the second 

order interaction ABC are divisible into m distinct classes such that the losses of 
information in the i-th class are all equal to. say. /<(*=, 1,2 ./a). 

2.2. Partially fjalunced incomplete, block designs. It will be shown in the sub¬ 
sequent sections that the PBAF designs, as defined above, can readily be constructed 
from PBIB designs with m associate classes. 

An incomplete block design is said to be partially balanced with in associate 
classes if it satisfies the following conditions ; 

(i) the experimental material is divided into b blocks of k plots each, 
different treatments being applied to the units in the same block ; 

(ii) there are v treatments, each of which occurs in r blocks ; 

(iii) there can be established relations of association between any two treat¬ 
ments satisfying the following requirements : 

(a) two treatments are either 1 st. 2 nd. ... or /a-th associates ; 

(b) each treatment has exactly »-th associates: 
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(c) given any two treatments which are /-tli associates, the nuinher of treat¬ 
ments common to the >th associates of the first and the fc-th associates of tile second 
is p) t and is independent of the pair of treatments with which wo start. 

Also. 

PU = Pti ■ 

(iv) Two treatments which are »-th associates occur together in exactly A ; 

blocks. 

In this paper, we have extensively used the group divisible (GD) designs 
for purposes of construction of PBAF designs. As is well known, the GD designs 
are a special class of the PBIB designs with two associate classes in which the v treat¬ 
ments can be divided into » groups of m treatments each such that any two treatments 
of the same group occur together in A, blocks and any two treatments from different 
groups occur together in A 2 blocks. We have also made use of trivial GD designs for 
which k = m. A, =5 r and A s = 0. 

Construction of PBAF oksions of tiik oi.axs 7 x 2 * 

3.1. 7 x 2 * design* associated with PBIB designs. Let the treatments ho all 

combinations of the three factors A(a 0 .a x .a. t . B(b 0 . 6 ,) and 6 ’(c ft . c,). Also, 

let the treatment combinations b„ c„, b x c x he denoted by X 0 and b„c x . b x c„ by X x , Then 
we prove the following theorem : 

Theorem I : Let there exist a PBIB design for q treatments in b blocks of size 
k each with in associate classes. Then, if we write X 0 , X x in the pattern of the PBIB 
design and fill in the remaining places by X x . X 0 , we get a PBAF design »/x 2* of order m 
in which the loss of information on BC is (q—2k) i /q t . 

We shall prove the above theorem by analysing the design by fitting constants 
by the method of least squares. Let the constants to bo fitted ho chosen according 
to the following scheme : 

blocks : 6 ,„ 6 12 . b u , b u . b 6x . b br with 6 ,,-f 0 1,2 . 6 ); 

interaction BC : ( 6 c) 0 , ( 6 c),. when ( 6 c ) 0 =* -( 6 c), ~ ( 6 c): 

interaction ABC : {abc),{abc), .(<. 6 c),-, with*2 (oftc). = 0 . 

»-0 

Let it. denote by B n and B„ ( j = 1,2 . 4 ). tUe block tota| , in the .y, 

replication: by [B(7] the ordinary total for the interaction ( 6 c), i.e.. the total of(X -X ) 
in all the replications; and by MBC), the ordinary total of (X,-X,) with in all the 
replications. 

The normal equation for determining the constant (be.) then comes out to be 
4 {«? a 6 — 6 ( 7 — 2 fc)*} ( 6 c) = 7(BCJ+(7-2jt) £ (B fx -B j2 ). {3 l) 


Then the estimate of ( 6 c), denoted by ( 6 c), is given by 

( 6 c) = —_— 

4 [ 7 * 6 - 6 ( 7 - 2 ^], 


(3.2) 
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Where 7<? = 9l^]+( 9 -2fc)E 

W 

From (3.2), it follows that the relative information on Z?G’ as compared to an uncon- 
foundod design is 


</*-(?- 2k)* 

7* 

Hence, loss of information on BC in this design is given by 


(3.3) 


HBC) = <2z££ . ... (3,4) 

Now the normal equations for determining the constants (abc), (* = 0. 1. 7 —1) 

can be written as 


4%-l)(a6c),— 4 £' (6-4r+4A,*)(a6c)*= q(R ( -R) (i = 0 . 1 . 7 — 1 ) ... (3.6) 

**•-0 

whore A a . is the number of times the i-th and fc-th varieties occur together in a block 
in the parent PBIB design. 

'/B, =3 f/[A BC] t —‘2 (Block totals containing a t X 0 ) 

*ZR t 

and ft =-1 irft . 

7 


Lot (abc), (1 =■ 0 , 1 . 7 — I) be the estimates of the constants (nbc)t 

(i = 0 , 1, .... 7 —I) satisfying the equations(3.5). Then, these can be written in matrix 
notation as 


where 


ct — qR 


a 


<*o* 

«o. 


a 


*1. f-1 

• 

• 

• • • 

• 





• 

* 


• 


i.i 

... 

a 


(3.6) 


t = {(abc) 0 . ( abc) t .(o5c) # _,}, 

R = {7? 0 -K, R x -R . 

and « = 46(7—1) 

a 0 = - 4 ( 6 - 4 r + 4A <> ) (i * j = 0 , 1 , 2. q-l). 

The matrix C(q X 7 ) is of rank ( 7 —1), and hence one of its latent roots is zero, 
the remaining ( 7 — 1) roots being real and non zero. The a./s in each row and column 
of this matrix fall into m classes in accordance with the PBIB design used in construct¬ 
ing this design. Consequently, as proved by Boso and Mesner (1959), of the ( 7 — 1) 
non-zero latent roots, only m are distinct. It. therefore, follows (Kompthorne, 1956) 
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that the ( 7 -I) orthogonal unitary components Monging to tlu- interaction ABC fall 
into m distinct classes, and so also do the corresjH.nding losses of information. I he 
<lesign is, therefore, a PBAF design of the wth order. 

3.2. Special types of 7 X 2* designs when 7 is even. In the previous section, 
it has been established that if there exists a PBIB design of 7 treatments in // blocks 
of k plots each, wo can immediately obtain PBAF designs of the class 7 / 2 2 in 26 
blocks of 2 V plots each. However, when 7 is even, then- always exists a trivial GIJ 
design in two blocks of 7/2 plots each, the two blocks together constituting a repli¬ 
cation. We write A 0 , A', in the pattern of the GD design tilling in the remaining places 
by A,. A' 0 . This gives a PBAF design of the type 7 x 2 2 in 4 blocks of 2 7 plots each, 
in which the interaction BC is unconfounded. 


When there exists a PBIB design for 7 treatments in b blocks of 7/2 plots 
each, we can obtain a PBAF design in 6 blocks of 27 plots each. Such a design is 
obtained by the device of writing A 0 in tho PBIB pattern and filling in the remaining 
places by A',. Here the interaction BC will remain onconfoiindcd. This design 
will remain resolvable or non-resolvable according as the associated PBIB design is 
resolvable or non-resol cable. 

3.3. Illustrative examples are given below. 

Example 1 : *> X 2* design associated with trivial VI) design. Consider the 
trivial (JD design in two blocks of 3 plots each, the two blocks being ( 0 , 1, 2) and (3. 4, ">). 
The PBAF design 6 x 2 *, which is resolvable, associated with tho (ID design, is given 
in Table 1 . 


TABLE I. «x2i DESIGN IN 4 BLOCKS OK 
12 PLOTS EACH 


loveU of A 


block* 


I 

II 

HI 

IV 


Xo 

X, 

x, 

Xo 


X. 

X, 

X, 

Xo 

O; 

Xo 

X, 

X, 

X. 

o 3 

X, 

X. 

X. 

X, 

a* 

X, 

X. 

X 0 

x, 

«» 

X, 

Xo 

Xo 

X, 


Hero interaction BC is unconfounded. Of the 6 d.f. belonging to tho inter¬ 
action ABC, 4 d.f. remain unconfounded and the contrast 

Jr- 

carrying one d.f. is completely confounded. This, therefore, is a PBAF design of tho 
socond order. 

Example. 2 : 6x2* design associated with OD design. Consider tho following 
PBAF design 0 x 2 * in 4 blocks of 12 plots each associated with tho GD design for 6 
varieties 0, 1, .... 5, in 4 blocks of 3 plots each given by ( 012 ), (045) (135) and (234). 



162 


K. KISHEN AND B. N. TYAGI 


TABLE 2. 0x2' DESIGN IN 4 BLOCKS OF 


12 PLOTS EACH 


levels of A 


blocks 


I 

II 

III 

IV 

a n 

-Yo 

Yo 

Y, 

Y, 

a, 

Yo 

Y, 

Yo 

Y, 

O; 

Xo 

X, 

Y, 

Yo 

**S 

X, 

Yi 

Yo 

Yo 

n* 

x, 

Ya 

Yi 

Y u 


X, 

Ya 

Yo 

Y, 


111 this design, which is non-resolvablc. the interaction HC is unconfounded. 

The variance-covariance matrix of (nSc),. (» = o. 1 ..... v -l) is as under : 


13 

2 

2 

5 

2 

2 

96 

96 

96 

96 

96 

96 

2 

13 

_ 2 

2 

5 

2 

06 

96 

96 

96 

96 

96 

2 

2 

13 

2 

2 

6 

96 

96 

96 

96 

96 

~96 

5 

2 

2 

13 

_ 2 

2 

96 

96 

96 

96 

96 

96 

2 

5 

2 

2 

13 

2 

96 

‘ 96 

96 

96 

96 

96 

2 

2 

5 

2 

2 

13 

96 

96 

96 

96 

96 

96 


It can then be readily seen that the five contrasts given in Table 3, each carrying 


one d.f., belonging to the interaction ABC , are mutually orthogonal and that the loss 
of information on these contrasts is as given in the Table below : 


TABLE 3. LOSS OF INFORMATION ON EACH DEGREE OF FREEDOM 
BELONGING TO ABC 


si. 

no. 

contrasts 

d.f. 

loss 

1. 

JL Uabc) 0 -(abc) 3 ) 

V 2 

1 

1 

3 

2. 

* l(Ac),-(a*c).) 

v/2 

1 

1 

3 

3. 

V 2 

1 

1 

3 

4. 

* {(abc)o-labc),+ lobe)*-(abc) t ) 

I 

0 

5. 

1 {(a£c) 0 + (abc), — 2{aSc)j+ <a&c) 3 + (abc) , - 2(aSe) 9 } 

V12 

1 

0 
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4. List of useful pbaf dksions ok the class 7 x 2 *, 7 even 
In Table 4 is presented a list of some of the useful PBAF designs of the class 
7 X 2 2 associated to UD designs, the plans of which are given by Hose, Clal worthy and 
Slnikhande (1954). 

TABLE 4. PBAF DESIGNS OF THE CLASS qxV ASSOCIATED TO CD DESIGNS 


si. 

no. 

•lonijjii 

Mock si/e 

number u! 
blocks 

number of 
replication* 


ussuciato'l GD <le*iRn 


V 

k 

b 

r 

1 

0 x 2 - 

12 

4 

2 

0 

3 

4 

2 

2 

• 10 x 2- 

20 

8 

4 

10 

& 

8 

4 

3 

12 x 2- 

24 

0 

3 

12 

0 

fl 

3 

4 

14 x 2* 

28 

8 

4 

14 

7 

8 

4 

5 

IS X 2* 

30 

10 

A 

18 

0 

10 

5 

0 

20 X 2* 

40 

C 

3 

20 

10 

0 

3 


The above designs are nil PBAF designs of the second order in which the inter¬ 
action BC is unconfoundcd. However, if we utilize the trivial (il) design in each of 
the six cases, we shall obtain in all these cases PBAF designs of the second order in 
4 blocks or 2 replications only, it would thus he seen that by use of the trivial (ill 
design, a marked reduction in the number of replications is brought about in respect 
of all the designs except the tirst. 

We have so far considered designs for 7 even. For values of 7 = 9 , 15 and 21, 
01) designs exist with b — 3. 3 and 7 and k = 0 , lu and 9 respectively. Consequently, 
for the 9 x 2 2 . 15 x 2* and 21 x 2* designs. PBAF designs of the second order in 0, 0 
and 14 blocks of 18. 30 and 42 plots each respectively have been obtained. In these 
designs, however, the loss of information on BC is 1/9. i/9 and 1/49 resjiectively. 
From (3.4). it follows that the minimum loss attainable on the interaction BC in 7 x 2 2 
designs, when 7 is odd, is 1 A/ 1 . Nevertheless, these designs are of practical utility owing 
to the small number of replications these require. 


5. Construction of PBAF designs of the class 7 x 3 * 

Lot the treatments be all combinations of three factors A(<? 0 . a,. .« ), 

H(b 0> 6 ,. b 2 ) and C(c 0 ,c,.c a ). Also let the treatment combinations b„c 0 , b t c 2 , b a r l be 

denoted by J„. V.. Vo. V. l>y J,i »»d V,. V„ Vo by J, Then we prove the 
following theorem : 


Theorem 2 : If « e have a PBIB design for q treatment, 0 block, of L- plots 
sad,,o,ll, m assoc,alt classes, and if tee writ, J„,J, , ht o{ , hf pB , B . 

and fill ,n the remaining places by J„ J„ J 0 , ,« ge , a PBAF d c silJ „ x 3 , . onfcr 
in b3 blocks of 3 7 plots each . 


This theorem can easily be proved by analysing the design by fitting cons- 
tants by the method of least squares, as in the ease of Theorem 1. Lot the constants 
to be fitted bo chosen according to the following scheme : 

20 
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general mean : /* 

blocks : b Jt , b J2 , b i3 .fi(j = I, 2, ... 6) withjs b jk = 0; 

interaction BC (./) : j 0 ,j lt j t with j 0 +ji+j 2 = 0; 
interaction ABC ( J) : (aj 0 ). (a,j ,). ( a,j 2 ), (i = 0, 1, 2. ..., 7-I) 


with £ (a.j*) = 9a, andV (a,j k ) = *j(j k ) (k = o, I, 2). 

*-0 i -0 

Also let Bj i% B /4 {j = 1,2.6) denote the block totals for the first, 

second and third blocks respectively in the j-th replication, (./•.] the total for the inter¬ 
action corresponding toy* (k = 0, I. 2) and [AtJ k ] the totals for the interaction corres¬ 
ponding to (aJ K ) (» — 0. 1, 2. q— 1, k — 0, 1, 2). 

The normal equations for determining the constants j 0 ,j l and j 2 then come 
out as under : 

»bk(q-k)j, = q(J 0 )-k Z B ix -(q-k) £ B, 3 

i-i j-l 

Ublciq-k)^ = B^-kZ B t , >. ... ( 5 . 1 ) 

II hk{q-k)j, = qVti-to-k) £ B„-k £ B„ ! 

l-i l-i 

From (5.1), the loss of information on each d.f. belonging to BC(J) can easily bo worked 
out and is given by 

UBC(J))=t~^L . ... ,0.2, 

Now the normal equations for determining the constants («,y,.)(i = <>, 1, .... 7—1; 
k = 0, 1, 2) can be written as 

3%-l)(«i> 0 )-3 s‘ (6-3r+3A„)(« Wo ) = q(B n -S e ) 

t *<-0 

3%-lKaJ,)-3 f £ (6-3r+3A,*)(«*,») = 7 (/<„-*,) 

Wi -0 

3%-lKa f /,)-3 f £ (6-3/-+3A.*) («*> 2 ) = 7(/f ia -/f f ) 
tni-o 

where A,* is the number of times the »-th and k-th varieties occur together in a block 
in the parent FBI 15 design, 

R ik = •&A i J k )-(totals of blocks containing «,./*), 


[ ... (5.3) 

I 

J 


and 



V R ik 

1- o 
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Let a contrast belonging t«» 

( 2 P, n i) ( - Ut) - 

M-0 ' ' * -o / •—» 


the interaction ^BC(./) be symbolically represented by 

n. = v / n and ( s'p*) ( $ /?) = I. and let <«,>*) »>« 
t-0 M=l • ' *-«» ' 


the estimate of constant («j t ) obtained from (5.3). 

From (5.3), it can then be easily found that t he variances for, and consequently 
losses of information on. the 2 ( 7 — 1 ) orthogonal contrasts belonging to ABC(L) fall 
into in classes. 


The design is. therefore, a PBAF design 7 x 3 * of the wi-th order. 

">.2. Special hjjns of PBAF designs of the class 7X3* (7 = 21 or lit). In the 
previous section, it has been established that if there exists a PBIB design for 7 
treatments in b blocks of k plots each, we can immediately obtain a PBAF design 
7 X 3 * in 3 b blocks of 3 7 plots each. However, when 7 is even, there always exists a 
trivial GI) design in two blocks of 7/2 plots ouch, the two blocks together constituting 
a replication. We write J„. «/,. J . in the GD pattern, filling in the remaining places 
by ./,. ./ 0 . This gives a PBAF design of the type 7 x 3* in 6 blocks of 3 7 plots each, 

the loss of information on each d.f. of BC{J) being ( 7 1 — 37 *+ 3 £*)/ 7 *. 

When 7 = 3 1. we can always obtain a trivial GI) design for 7 treatments in 

3 blocks of 7/3 treatments each. By arranging the treatments in blocks such that the 
first 7/3 treatments are placed in the first blocks of each replication, the remaining 
-7/3 treatments being placed in the second ami third blocksof each replication unequal 
number of times, and then writing J„ in the pattern of this GD design and tilling in 
the remaining places bv ./, and J t . keeping the following order, we obtain a PBAF 
design 7 X 3 * of the second order. 

d 0 , J v ./, 

A. A. Jo 

Jf •/.. J 1 

Here the interaction BC will remain unconfonndcd. This design would bo 

resolvable and can always be obtained in only two replications. 

5.3. Illustrative examples are given l»elow. 

Example. 1 : PBAF design 4x3* 0 / the second ord*r. Consider the PBAF design 

4 x 3* associated to the trivial GD design for 4 varieties 0, 1, 2 and 3. constituted by the 
two blocks (01) and (23). We then get the following PBAF design 4x3* in 0 blocks of 
12 plots each. 


TABLE 5. PBAF DESIGN 4x3' IN 0 BLOCKS OF 12 PLOTS EACH 


levels of A 



replications 




I 


n 


1 

2 

3 1 

2 

3 

ao 

Jo 

A 

Jt Jx 

Jt 

Jo 


Jo 

Jt 

Jt J x 

Jt 

Jo 

a : 

J, 

J'. 

Jo Jo 

Jx 

Jt 

03 

Jx 

Jt 

Jo Jo 

Jx 

Jt 


lofi 
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In tins design, the loss of information on each of the partially confounded d.f. 
belonging to BC (.7) and ABC(J) is as shown in Table 6. 


TABLE 6. 

LOSS OF INFORMATION ON EACH d.f. 
TO BC (J) AND ABC (.J ) 

BELONGING 

interaction 

contrasts 

d.f. 

loss 

BC (J) 1 

2 

72 

(/•+>!—2/*i 

1 

1 

i 

1 

ABC (J) 1 

J- (o 0 -a. + oj-aj) (/©-/,) 

1 

0 

2 

V24 <••-••+•»-«■> (A+/i-2/t) 

1 

0 

3 

Jg <«• -«• + °>) (/. -A) 

1 

0 

4 

3 

7f4 <a0_o, ~°*+ ifo+Ji -2j\) 

Ji Ji) 

1 

I 

0 

3/4 

6 

s /24 (••+«!—(£+/«—*/>) 

I 

3/4 


This design is, therefore, a PBAF design of the second order. In contrast with 
the corresponding balanced asymmetrical factorial design 4x3*. which requires 15 
blocks of 12 plots each, the above design requires only fi blocks of 12 plots each and 
thus brings about a marked reduction in the number of replications. 

Example 2: PBAF design fix 3* associated with trivial CD design. Consider 
the fiX 3* design in fi blocks of 18 plots each associated to the trivial GD design with 
fi varieties given by the fi blocks (01), (23), (45), (01), (45), (23). 


TABLE 7. 6x3* DESIGN IN 6 BLOCKS OF 18 PLOTS EACH 


lovols of A 



replications 




I 



II 


1 

2 

3 

1 

2 

3 

a 0 

Jo 

Ji 

Jz 

Jo 

J. 

Jz 

0 1 

Jo 

J 1 

Jz 

Jo 

Jx 

Jz 

aj 

J 2 

Jo 

Jx 

Jx 

Jz 

Jo 

03 

jZ 

Jo 

Ji 

Jx 

Jz 

Jo 

*4 

J, 

J r 

Jo 

Jz 

Jo 

Jx 

«*9 

J, 

J; 

Jo 

J ; 

Jo 

Jx 
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In this design, the interaction BC is unconfouiuled. The loss of information 
on each of the 10 d.f. belonging to the interaction ABC(J) is as shown in lablo 8. 

TABLE 8. LOSS OF INFORMATION ON EACH .If BELONGING 

TO ABC{J) 


"IT 

no. 

contrast* 

d.f. 

low 

I. 

£ (do-di) 0-.fi) 

1 

0 

2. 

(«0-£,)(/•+>!-&> 

I 

0 

3. 

J («*—«,) </•-*) 

1 

0 

4. 

2 ~J$ (°J—«») ti»+ji—V:) 

1 

0 

8. 

J (ai —a*) 0»-/i) 

1 

0 

8. 

2 «•+/.'-*/«) 

1 

0 

7. 

1 » » » » » » 
ijr, (°o+ai-o.'-aj) 0»“>i) 

I 

* 

8. 

2 Jg 

1 

* 

9. 

f“jjj (*• + •! + «* + «■-•■•-*■») (/• -/l) 

I 

* 

10. 

6 ^ (a« + S, + a, + o', - 2o‘,-2^,) (>,+/,-2/,) 

1 

4 


The design is, therefore, a PBAF design of the second order. 

6 . List of useful PBAF designs of the class 7x3*(^=s2 < or 3f) 

A list, of some of the useful designs of the class 7 x 3 * associated with trivial 
GI) designs is presented in Table 9. 


TABLE 9. PBAF DESIGNS OF THE CLASS 9 x 3 : 
ASSOCIATED WITH TRIVIAL OD DESIGNS 


si. 

no. 

dasign 

block size number of 
block* 

~>*on 
each d.f. 
of BC(J) 

total loss 
on ABC(J) 

1 

4 x 3 * 

12 

6 

i 

3/2 

2 

6x3: 

18 

6 

0 

2 

3 

8x3* 

24 

6 

3 

3/2 

4 

9x3* 

27 

6 

0 

2 

6 

10 x 3* 

30 

6 

1 

3/2 

8 

12 x 3* 

36 

6 

0 

2 
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7. PBAF DESIGNS DERIVABLE BY USE OF PSEUDO-FACTORS 
Kishen and Tyagi (1961) have proved that balanced designs of the typo 

7X J> 2 . "here q = p \ s being any positive integer, can be obtained in q— 1 replications. 

However, when we take only m replications, where in < 7— I, we obtain PBAF designs 

of the second ordei in m replications. 
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ON THE APPROXIMATION OF DISTRIBUTIONS OF SUMS OF 
INDEPENDENT SUMMANDS BY INFINITELY 
DIVISIBLE DISTRIBUTIONS* 

By A. N. KOLMOGOROV 
Academy of Sciences, U.&.8.R. 


Throughout this paper 

4 " 5l+S*+.... 

is a sum of n independent real random variables, 

- POk < x), H(x) = pa<x) 


i r 

G.i(x) = I e ' t&dx, a > it 

V2"J<c 

CO if *<0 
6 (r) - O 0 (x) = < 

L1 otherwise, 

v ~ {D) is the totality of all infinitely divisible distribution functions D{x) 
and c,, c a , ... are positive constants. 

The following strengthened versions of two theorems, the weaker forms of 
which wore given in my work (Kolmogorov, 1956) will bo proved : 

Theorem 1 : There exists a constant c, such that, in the case of identically 
distributed l k , whatever be F(x) = FM, 1,2,...,*, there exists Dev satisfying 
the inequality 

| D(x)-U(x )| <c,n->'» ... ((U) 

for all x. 

Theorem 2 : There exists a c, such that, for any t > 0, L > 21 > o the validity 
of the inequalities 

E{x-l)~, < FM < £’(x+l)+ t ,0.2) 

for all x and k = 1,2, .... n, implies the existence of a Dev for which 

Dfr-L)-i < Ulx) < D(x+L)+i ... (0 . 3) 

for all x, where 

4 - *““ (x('og 7 )*.«-)• ...(0.4) 

So goes the history of this problem. 


• Translation of 


lecture delivered .. Ire Indta Sutistid Witute. Clcutte. April 
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1. From the closure of the class of all infinitely divisible distributions, intro¬ 
duced by Bruno de Finetti (1030), under weak convergence it immediately follows 
that in the case when the sum 

**-«*+...&** (0.5) 

lim n k = oo 

t —*00 

of independent summands which are identically distributed within each series, converges 
weakly the limit distribution is infinitely divisible. 

It was tempting to understand this result thus : sum of a largo number of 
identically distributed independent summands has a distribution, approximately 
normal. However, before my work (Kolmogorov, 1956) such an interpretation was 
not fully convincing. 

Even in the case of a sequence of identically distributed summands 

£i» ••• 

a ‘completely different’ case was possible according to Doeblin (1959), in which under 
no normalisation 

and for no sequence n t < n 2 < ... < n k < ... 

the distributions of the sums can converge to any distribution other than the dege¬ 
nerate distribution E(x—a). The latter, of course, can be achieved by choosing the 
multipliers A n sufficiently small. 

Only in 1955 Yu. V. Prohorov proved that, in the case of sequence of 
independent and identically distributed summands there always exists a soquence 
of infinitely divisible distribution functions 

/>,(*). D t (x) ./>„(*), 

approximating the distribution //„(*) of the sums 

Zn = 

in the sense sup | H n {x)—D n (x) |-> 0, ... (0.6) 

X 

as n—>oo. Prohorov's work (1954), however, left open the question whother the 
convergence in (0.6) is uniform with respect to the choice of the distribution function 

F(x) of Z, n . 

In terms of the uniform metric 

p{F', F-) = sup \F‘(x)-F-[z)\ 

X 

the problem is as follows : do the functions* 

t( n ) = sup p{H«,v) 


converge to zero as «-*oo! My work (Kolmogorov. 1956) gave the answer to this 
question; it was proved that 

4 f{n) = O jn -“*). __ • (Q ‘ 7) 

taken over nil distribution functions F. 


LIMIT DISTRIBUTIONS 


1«1 

III 19UU Prohorov strengthened this result, by showing that 

*(») = 0(n- 1/3 log*/i). ••• ( u ») 

Our Theorem 1 states that* &(n) = 0{n~ in ). ••• (^-®) 

Tho problem of estimating the function i^(n) from below naturally arose. 
Prohorov's students I.P. Tsaragradsky, Prohorov himself and L. L>. Meshalkin oecu- 
pied themselves with such estimates. The latest result of .Meshulkin (1'JOl) runs 
thus : 

f(n) > c,n-^log ... (0.10) 

2. For tho caso of sums 

s* = 5*,+... 5*., 

of random variables, independent within each series, with different distributions, 
Khintchinc (11157), determined sufHcient conditions so that tho distribution of 5* 
may converge weakly to an infinitely divisible distribution. Tho conditions are that 
there exist 

€*->0, /*-> 0 

such that tho distributions F kt of satisfy 

E(x-l k )-t k < F k fx) < £(*+/*)+**. 

Our Theorem 2 is an attempt to give an ‘uniform’ character to tliis result of 
Khintchinc. The nature of tho content of Theorem 2 can bo made clearer with the 
help of "Levy distance," 

p k {F\ F‘) - inf c 
over all £ satisfying tho condition 

F'(x—en)—e < F'(x) < F'(*+ € A)+ £ . 

It is easy to seo that from Theorem 2 we have the following corollary. 

Corollary : If 

sup p k (F ki , E) < v 

" m Pilfl, V) < c,V«. 


3. As is known, tins most useful means of proving limit theorems for distri¬ 
butions of sums of a large number of independent variables is the apparatus of oliarac- 
teristie functions. The •direct' probabilistic method now in this domain can o.dy rarely 
compete with tho potentialities of the analytical apparatus of characteristic functions 
Our Theorems 1 and 2 are unusual examples of tho other situation. Tho essential 
element of then- proofs is Lemma 1, relating to the ‘concentration funotion’ introduced 


* Af “' <W 1 <» >“.w r. U. Kagan. 1061, discuveicd U.O ,a.ul, 

* (H) « 0(*-l/S lug „) 

which is between (0.8) and (0.9). Later this result was reported by F M Kara., in r 

ProbobiUty Theory and Mathematical Statistics held in Fcrgau (September 1 U 02 , “ 

21 
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by Levy. Theorems of Levy and Doeblin about the properties of concentration func¬ 
tion were strengthened by me (cf. Kolmogorov, 1958) specially for proving the earlier 
versions of Theorems 1 and 2 given in Kolmogorov (1956). The later development 
in the estimation of concentration functions belongs to Rogozin (1961a; and 1961b). 
Rogozin too uses elementary direct probabilistic and set theoretic methods (Theorem 
5.5 on subsets of a finite set). 

The mathematicians, whose attention to this problem I succeeded in drawing, 
could not prove theorems of type 1 and 2 without appealing to the just indicated 
peculiar methods. 

Throughout this paper, as in Kolmogorov (1956), tho methods of reasoning are 
essentially those introduced by Doeblin (1959). As is seen from what is said above, 
the transition from the degree 1/5 to the degree 1/3 in Theorem 1 was done by Prohorov. 
The removal of the factor log 2 /* in the estimate of Prohorov (0.8) required (a) tho use 
of a more precise estimate of tho concentration function obtained by Rogozin and (b) 
some changes in Prohorov's proof, reflected in the introduction of Lemmas 5 and 6.* 

In the proof of Theorem 2 the transition from tho degree 1/5 to the degree 
1/3 is effected by the techniques borrowed from the work of Prohorov (1960) combined 
with the use of Lemmas 5 and 6. 

4. Besides tho distance 

pif, F') - sup | #"(*)- 

it is natural to consider ‘the variation distance' 

,> V (F\ F") = 1 var[/’ (x)-F»j = sup [F'{A)-F'(A)) t 

whoro A is an arbitrary Borel measurable set on the real lino. 

As is known, p(F', F") < p t (F' , F'). 

Hence for the function = sup pviF", v) 

we have the inequality vM n ) > ^( n >- 

However, nothing is known about the asymptotic behaviour of tjfy(n). It 
is not even known whether 0 as n-> co. 

I. Eight l km mas 

Following Levy, for any distribution function F(x) wo introduce the concen¬ 
tration function’ 

QM = sup [F(x+l+0)-F(x)) 

Lemma 1 : If , for k — 1, 2, ... n, L ^ ^ 0 

< *,-} = m* >*.} = ! 

then QnM < J »”*• 

• Tl.o first stop was done by F. M. Kogan sometime before my work woo written (*oo footnote 
on pago 161). 


LIMIT DISTRIBUTIONS 

Lemma 2 : If <r > 0, l > 0, y = c e e -,,/2<r \ then for any distribution 
function F(ar) 

F.G^x-D-y < F(x) < F.G oi (x+l)+y. 

Lemma 3 : // rr > 0, tj x > 0, then 

10„,(*)-0..(x)| < c, 3-1 

* 

Lemma 4 : If \xF(dx) = 0 , Jx*F(dx) = <r*. A > <r > 0 

Mew £ sup I jP(ar)—| < Cg. 

ra- 00 rAfi x£ (r*l)A 

LcmmaS: If M^ k = 0, Z>* = <r*. A > tr > 0 

Men 2 sup I //(*)— O n Ax)\ < c # tier. 

r—» rA«x<(r+l>A 

Lomma 6 : If Mi, k « 0, | 5*| < l, Df, = <r 2 , erf = <r 2 +<rj 

Men | H*Q al (x)-G oX {x) | < c I0 //<r,. 

Lemma 7 : /’or any natural number n and 0 < p < 1 


Lemma 8 : Let ' 


£ | Cp-(1—1»—«-* <e u p. 
■«=o | mi 

0 < P* < 1 
'i-p* i/ m == 0 

p 4 (m) = p k if m = ] 

.0 */ m > 1 

,1,m) - % *"'* 

ZK») = JI p 4 (ro 4 ), y(»i) = ny 4 (m 4 ). 


Z|lK»)-gCll)|< CM 2frf. 

m * 


•Her© and everywhere in what follows in a (m, __ _ _. , 

' •**» 18 8n " dimensional vector and 

denotes summation over all vectors with non-negative integral components. 


5' M 
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Lemmas 2, 3, 5 are proved by simple calculations. Lemma 1 is an immediate 
corollary of Theorem 1 of Rogozin (1061a). Lemma 7 is proved in the work of Prohorov 
(I0.-.3), Lemma 4 follows from the estimate (5 has distribution F) 

\F(x)-E(x)\ < 7>{| 5 | > |:r|} < <r*/x* 

(Chebyshev's inequality). 

Lemmas 5 and 6 reduce to the known estimate 

|/7— O a ,\ < cellar ... (i.l) 

which follows from Lyapunovs theorem in the formulation of Esseen (Gnedenko and 
Kolmogorov 1949, p. 216) 

^ 2 ... ( 1 . 2 ) 

Lemma 6 can be obtained from (1.2) if tho adjoined normal summand with 
dispersion o-g is represented as a sum of a large number of summands with sufficiently 
small dispersions. 

Tho proof of Lemma 8 is somewhat more complicated. 

2. Proof of theorem 1 

1. Hereafter wo shall assume n > 1. It is easy to see that this restriction 
is immaterial. 

2. Further we shall assume that 5* are non-decreasing functions 

5 * — Fi\Vk) 

of mutually independent variables ij K with uniform distribution on tho interval [0, 1 ]. 

It is easy to prove that in an extended probability field (ft, m, P) such quantities 
y k exist. 

3. Suppose 

p = n~ ,/3 

fo if p/2 < y t < l-p /2 
// • - < 

| 1 otherwise, 
a = 3/(5*|^*=0) 

<r* = Da k \Pt = 0) 

A(x) = P{f, k < x\,t k = 0); B(x) = P{5* < x\,, k = 1). 

Under the transition from the quantities 5* to 

Si = Zk -a 

all these constructions remain unchanged. Only instead of a we have a' = 0 and the 
functions A(r) and B{x) become 

A’(x) = A(x+a)\ B\x) = B{x+a). 



LIMIT DISTRIBUTIONS 


Thus it is enough to consider tho case 

a = 0 

and to this wo shall restrict ourselves hereafter. 

4 . In the decomposition F(x) = pB(i)+(l-p)d(r) tho distribution A is 
concentrated in tho interval [x~, x ¥ ], whore 

ar - F-Hpl2 ). = F~'( 1 -j»/*)- 

Tho length of tho interval is 

A = x+—x-. 

The distribution B is outside the interval [x~, x+) and each of tho rays (—co, z - l 
and [*+, co) has probability 4 under B. To the distributions B m (here an«l elsewhere 
power is in thesenseof convolution), it is possible to apply Lemma I, which yields the 
estimate 

^b-,(A) < c s tn*. ... (2.1) 

5. Wo shall approximate tho distribution 

// = [ P B+(1-P)A )• « £ Cp-(l-p)--"/r./l—' 


by an infinitely divisible distribution D in two difTcront cases 

(A) A > \/n <r, ; (B) A < \/n <r. 

Case (A) : Suppose 

D = exp (np (B-JS)] = Z ( -2£>!L e-'B". 

m m! 

//, - z c? p m (\—p) % ~ m B m . 

m 

According to Lemma 7 

\D-H X \ < c,|p * c u • 

By IiOmmn 4 and estimate (2.1) when h = A we have* 

< J M— (*- 2 )-£(x_ 2 )|ir(<fc) 

< ? , “P M-"(y)-B(y)| < c,c, m->. 


Thus 


whore 


< c 5 c, n-*/*+2E', 

E'*= E c:j>-(l-p)"-= pyt < 


Observing that M/i = np = n z/3 

Dp = np( 1 —p) < n ,/s 
we obtain by Chebyshov’s inequality 

£' < P{|p-n^| > < 4n~* /s 


•The disporsion of the distribution is equal to (n-m)o’ so that tho conditions of Lemma 4 
are satisfied when h =• ,\ > a/no. 
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which, together with (2.4). leads to the inequality 

|| < (2c 5 c 8 +8)ti-*'3. 
From (2.6) and ( 2 . 2 ) we get (0.1). 

Case (B) : Suppose 

D = "VCnpCB-B)]*^ 


£ <-Sf 


• (2.7) 


"■ = 5 c " pm(1 -r>~ mBM ‘ 0 <»- m >,> 

a,-sc:p m d-p)--B-.o al ,_ p) ',. 

By Lemma 7 we have 

|Z>—/f t | < c n n-*'». ... (2.8) 

The difference //-//„ is estimated with the help of Lemma 5, where wo assume now 
h = Vna 

\B-.A~-B~.Q ( - 

< / \A’-"(x-z)G (n | B~{dz) 

<Q[!»,(•/»") £ . sup . | A"- m (y)—0. . . (y)| 

< c s m-*c 9 = c s c 9 m~K 

A \Zntr 

This estimate is completely analogous to the estimate (2.3) of caso (A). Exactly in the 
same manner as in case (A), we get 

c 6 c,n-*/»+ 22 ' < c 16 n-»'». 

The difference //, —// 2 is estimated with the help of Lemma 3 : 
where 2* = 2 c™p m (l — p) n ~ m . 


... (2.9) 


n —m _ j ^ Ci« 


n(l-p) >- e. 

It is possible to obtain from (2.5) and (2.6), when n > I and c 16 is chosen as above, 
with'the help of Chebyshev’s inequality, the estimate 

2 ' < c 17 n~ l/i 

which leads to | H\ — I < "* < 2 - 10 ) 

From (2.8), (2.9), (2.10) we obtain (0.1) which completes tho proof of Theorem I. 


LIMIT DISTRIBUTIONS 10 ' 

3. Proof of theorem 2 

1. Without loss of generality, wo may consider £ < 1. 

2. We shall show that it is enough to consider the case of continuous and 
strictly increasing functions F*(.r). 

Suppose that Theorem 2 has been proved with constant c' 2 for the case of 
continuous and strictly increasing functions. We consider the sum 

i - *»+••• 

with arbitrary F t (x) satisfying (0.2). Let L > 2/. Wo choose V and L' such that 

L>L > 2C > 21. l r .>\ 3 <>•» 

By Lemma 2 it is possible to choose such a small cr 0 that, for any distribution 1 unction 
F{x) the inequalities 

FtQ^x-A)-* < F(x) < < 0 a ,(*+A)+€ ... (3.2) 

F*Q na t{x-A)-r < F(x) < ^•0 M<rJ (x+A)+a' .. (3.3) 

whore A = 1-1', A - L—L' 

•»' = <* max (£ (log £)*. (fc''*)] 

are fulfilled. Let F' k = F k *G 93 . 

By (0.2) and (3.2) wo get 

E(x-l')- 2 t < /•;(*) < E(x+l')+ 2c. 

Since the function F' k are continuous and strictly increasing, there exists an infinitely 
divisible distribution D', for which 

D'(x—L')6' < H\x) < D'(z+Z/)+*'. ... (3 . 4) 

Observing that W = H*G a 

no o 

from (3.3) applied to /’(*) = H(x) and (3.4), wo obtain 

D'(*-L)-2<r < U(x) < D'(x+L)+26' ... (3 .4a) 

since, by (3.1) 2<S' < 2c; max [L (log , (2 £ )«/*j 

< c, max (log-5)*. e*»]. 

when Cj is chosen as above, (0.3) follows from (3.4a.) 
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3- In accordance with 2 we shall horeaftcr consider the case when F k (x) 
arc continuous and strictly increasing. Then the function 

*t(p) = Fi'il-pM-Fi'ipW 

wiH be well-defined lor all p, 0 < p < 1 , continuous and strictly decreasing. It takes 
all positive values. Therefore the inverse function p k (A) is defined on 0 < A < oo 
as a continuous strictly decreasing function taking all values in the interval 1 > p > 0 . 

The function 

s(A) = 2 p*(A) 

is also continuous and strictly decreasing. It takes all values 7 * > * > 0. Thus, 
when 0 < £ < 1, there exists a unique solution A 0 for the equation s(A) = e-*' 3 . 

1. Lot 

A r A « >' 

l l if a„-< l 
Pk — 7>*(A), s — s{ A) = 2 p k 

x k - (pm). - fz i (i - Pk/2 ) 

r 0 ***<«*< 

b 1 otherwise 

°* - M(ZklMk = 0 ), 

<xl = D(Z, k lp k =» 0 ), 
cr 3 = 2 (l-p*)<r*. 

Putting 

A k (x) = />{*;* < x\p k =0} : B k (x) = P{Z k < x \/t k — 1}, 
wo represent /*(*) in the form 

**(*) = P* £*(*)+(!-?*) 4*(*) 

whore the distribution is concentrated in the interval [x k , x£] and B k outside this 
interval such that the rays (—oo ] and [arf, oo) have probability £ each. 

Using the notations of Lemma 8 and putting* 

B(m) = n a(> n) = ruj- m * 

we obtain U — II [£>*#*+(1 — = 2 p(iii)B{in)*A(/n). 

h m 


value 0 


• B(m) is defined for arbitrary non-negative >»i* but A{m) only in tho cuse when m’s toko 
or 1. * 


the 
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The construction of the approximating infinitely divisible distribution will bo different 
in three cases (A), (B) and (C) : 


A 

B 

C 



K<i 

II 

< 

II 

< 

A = l 

3 = £-™ 

5 - £- ,/S 

3 = £-*/» 


5. Since A > l always 

Pk — J>*(A) < />*(/) < £. ... (3.5) 

It is only hero that we appeal to conditions (0.2) of the theorem in our proof. Since 
the definition of p k (A) and all other essential constructions are invariant with respect 
to shifts 


& - lk-c k 

wo can restrict ourselves to the case 

a k sb 0 . 

0. We shall mako some more simplifications which wo need in future. 

Lot r - S fi k , f(ff») =. E nt k 

* k 

r is equal to the number of times 5* lies in the interval * 4 : < ^ It is easy to 

verify that 

i/r-s 

/>r = ^ P*) < s. 

Thus, by Chebyshov's inequalities 


s mx’. 

U(*)-«|»r C* 


... (3.6) 


7. Lot further 


It is tho sum of all those 5* which lie in the interval *- < £ < x + 
assumption a k = 0 for all m 1 

Mt, = 0: i/(C|P = m) = o. 

Further wo aro interested in the conditional dispersions 


Because of the 


<r*(m) = Dtfjt = ^ 
p* — vH/t) 


For the random variable 
22 
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it is easy to verify that 
Since 


wo have 

Thus 


Mp 2 = a *. 

2(1—P*)*f = 

Pk = Pk( A) < p*(0 < £ 

Dp 2 < * cr*A 2 e. 

P( |p»-< 7 «| > C) = S p(«i) < 

|o*(m) —o*| < e 4c* 


8. Finally, wo observe that by Lemma 1 

«**<£) < «* j o «*>• 

Wo immediately pass on to the proof of Theorem 2 in cases (A), (B) and (C). 
Case (A) : In this case 

H = n (p*tf 4 +(l-p*)A*] = S q(ih) B(rh) * A(*7.) 

* m 

is approximated by D = exp E p k {B k —E) = £ g(m) B(rR). 

* m 

In order to pass on to D from H we further consider 

//, — E p(#a) B(fh). 

B 

By Lemma 8 and (3.5) 

|/)-//, | < 2 |p(m)- 9 (m)| < c ia 2 pf 

m * 

< C ia £ 2 p* < C lt £»' 3 . 

On the other hand, by Lemma 4 when h = A = A 0 > <r, and (3.8) 

|B(m)*A(m)-B(m)| < J | i4(*M*-*)-^(x-2) 15(»R)(<fc) 

< Q mini (K) 2 sup |A(m)(y)-A’(y)| 

r rXo < y < (r+1) X 0 

< C s Cg[l(B)]-*. 

| H-H l | < 2 p(m)|B(m).A(»n)-B(»7»)| 

m 

< y/2 C 8 c 8 £- ,/3 +22' 

2' = 2 p(m). 

*(-) < * « 5 '* 

Observing that in our case s = £ 2/3 , wo have by (3.6) 

S' < 8s- 273 < 4£>' 3 


(3.7) 


(3.8) 


(3.9) 


Thus 


whore 


(3.10) 

(3.11) 
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i.e., from (3.11) it follows that 

... 

From (3.9) and (3.12) wo obtain 

\H-D\ <ci # e» , ». - (3.13) 

Case (B) : In this caso wo put 

D = oxp 2 = 2 ?(>a) £(#*)•(?<,:, 

IN 

//, = £ p{m) B(>n)*O g t (m), 

m 

//, = 2 p(rh) B(m)*O a i. 

tn 

The inequality | D-U t \ < c lt *>/» ... (3.14) 

is obtained exaotly in tho same way as (3.9) was in case (A). 

By Lomma 5 when h = cr > A — A 0 and (3.8) we, obtain 
|B(m)M(ni)-B(m)*O o3 (»«)| 

< J| A{*)(x-z)-Q 9Hm) (z-z)\B(m)(dz) 

<$*<•>(*) 2 aup |4(*)—0®» ( i5>| ... (3.15) 

< c s crlAt,[t(m))~ l/i . c, A e/ . - c 6 c,[W]-*. 

Exaotly in tho samo way as (3.12) was obtained from (3.10) in caso (A), wo obtain 
from (3.15) 

< (c s c f +8)i»/». ... (3.io) 

It remains to estimate tho difference By Lemma 3 

|G«r t —0a„i,| < c„€» 
if 

«r • 

With tho help of (3.7) and taking into account that now A < <r we obtain the 
estimate 
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Ihus, analogous to the deduction of (2.10) in the proof of Theorem 1 , we obtain 

< (Ci.+c*)* 1 '*. 

From (3.14), (3.16) and (3.17) it follows that 

\H-D\ < c 2I e ,/3 . ... (3.18) 

The inequalities (3.12) and (3.18) show that in cases (A) and (B) the estimate (0.3), 

constituting the content of Theorem 2 can bo changed to the stronger one : 

D(x)— c w e ,/s < H(x) < ... (3.19) 

Case (C) : In this case, gotting an estimate of the typo (3.19) does not work. 
We suppose that 

°’o = 4- log y) ... (3.20) 

and introduce an auxiliary distribution 

H' - H*G al . 

By Lemma 2, if rj — c e e” Z '* /2<7 ® = l/L, ... (3.21) 

then H’(x — L)—y < H(x) < H’(x+L)+y. ... 13.22) 

Further wo shall show that the infinitely divisible law 

D = Z q(m) B(m)*Q o% , <r? = <r 2 +<rg 

fit 

satisfies the inequality |Z>—ZT|< c M J (*°8 \ )*]• ••• ( 3 - 23 ) 

Together with (3.21) and (3.22), (3.23) yields (0.3). 

It remains to prove (3.23). To this end wc introduce the distributions 
H\ = Zp («*) B(m)*G g]{ -y = o-2(m)+<r| 

= Z p( ) B(m)*G ar 

The proof of the inequality 




... (3.24) 
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is exactly the same as the proof of (3.9) and (3.14) in cases (A) and (B). But now 

* - s jm -*' 3 

k 

which leads to the estimate 

£pf < fS Pt < t’". 

By Lemma 3 p<«) - < 3 2s > 

where is taken over those ;>(»i) for which 

* 8 *) _1 > c * . ... (3.26) 

erf c. 

With the above choice of c u , it follows from (3.25) that 

|<rf(»)-<r}| = |*W—**)| > 

Thus by (3.7) and the inequalities the second inequality is obtained from (3.20). 

<r* < af A - / < \L < <r 0 

we have Z" < 5^} < 4 t ’'’- 

Thus from (3.25) we obtain 

<(c M +l) C , '». ... (3.27) 

Finally, by Lemma 0 and (3.20) wo obtain 

< ^ 2c >o (i( lo « x )*)• 

whence < y/*c„ ~ (log-^) ... (3.28) 

From (3.24). (3.27) and (3.28), (3.23) follows immediately. This completes the proof 
of Theorem 2. 
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MULTI-SUBJECT SAMPLE SURVEY SYSTEM: SOME 
THOUGHTS BASED ON INDIAN EXPERIENCE 
By D. B. LAHIKI 

Indian Statistical Institute 

Introduction 

1. The urge for quick economic and social development, so much in evidence 
in India after the attainment of Independence, had already prepared the ground for 
a persistent demand for necessary statistical information on which the plans and 
policies of the (Jox eminent were to be based. Being an applied science, the develop¬ 
ment potential in the field of statistics was thereby raised due to a real want awaiting 
fulfilment . It was left to the genius of Professor Mahalanobis to take advantage of the 
situation and devise quick and effective procedures for the actual development m this 
field. The establishment of the Indian National Sample Survey (NSS). a continuing 
integrated multi-subject multi-agency system of sample surveys, has been one of his 
important achievements in this direction. 

2. As one associated with tlu^Professor in the above endeavour (N T SS) from 
the very beginning ( 10 . 10 ) l have sometimes wondered what led him to the choice, 
straightaway, of this peculiarly unorthodox survey system. I could have asked 
him directly but I find it more exciting to speculate. There is a certain amount of 
fascination in linking up his general outlook in matters relating to statistical surveys, 
as far as I have been able to make out from contacts with him and his writings and 
previous work, with the factors which to my mind appear to favour such a system 
now. after years of experience in the NSS. I realise more and more what a deep in¬ 
sight he must have had in all crucial aspects of a survey when lie unhesitatingly voted 
for the adoption of a multi-subject sampling system. 

3. There arc two related but fundamental aspects on which the Professor 
has been continually laying special emphasis for more than a quarter of a century, 
viz.. (1) economy in time and cost and (2) appraisal and control of sampling and non¬ 
sampling errors, both being judged in relation to t he permissible margin of error of the 
required statistical information. In short, what he has been emphasising is rational 
use of resources, which is specially important for a comparatively poor country like 
India. It appears desirable to examine the suitability of the preferred survey system 
in this context. In other words one has to consider whether it is rational to adopt this 
particular system. 

Characteristics of selected survey system 

4. The preferred system is distinguished from other possiblo systems by 
four important characteristics, viz., ( 1 ) sampling organisation, as against census (or 
complete enumeration) organisation, ( 2 ) continuing, as against ad lioc (that is, 
working as and whon occasion arises) organisation. (3) multi-subject, as against 
single-subject organisation, and (4) deliberate and coordinated participation of 
multiple agencies, as against possible uncoordinated surveys on the same subject 
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>.v different agencies. The desirability of jiossessing these properties, which discri¬ 
minate this system from other possible ones, must be judged from the extent to 
which possession of such features proves satisfactory in relation to the aspects referred 
to in the previous paragraph. Before we pass on to a detailed examination of the 
merits of this system some observations on the nature of the above characteristics 
seem necessary. 

5. Consistent with the principles set down above, the system, in its sampling 
aspects, has good deal of flexibility. Different types of sample-units, —households, 
couples, individuals, land holdings, fields, markets, manufacturing or other establish¬ 
ments, etc., may be simultaneously canvassed, if advantageous. 

6 . Again the continuity may be in two rospeete, (1) a full-fledged organisation 
carrying out survey (data collection) work with no break, and (2) a nuclear organisa¬ 
tion which is small and of a continuing nature but which expands temporarily to carry 
out surveys from time to time. Essentially it is the first type of continuity which 
has been preferred. In a sense, a more correct statement would be that a combina¬ 
tion of the two types is the one chosen, because, marginal increase in field strength 
to accommodate an ad hoc enquiry is not completely ruled out. 

7. In regard to the integrated multi-subject nature it must bo romarkod that 
the system favours collection of data on different subjocts. not necessarily from the 
same sample units, in a single joint survey operation. The subjects may bo alliod 
household-enquiries, say, on employment and migration, and a single integrated house¬ 
hold schedule may be used (with multiple visits to sample households, if necessary); 
or they may bo as remotely related as village characteristics, crop-cutting experiments 
and prices of agricultural commodities, whore the sample-units must necessarily be 
different. In case joint survey is not considered technically desirable, data may bo 
collected simultaneously by different wings of the same organisation for different 
subjects, or for different sectors like factory and household sectors for enquiries on the 
manufacturing enterprise. 

8 . The system provides for a coordinated approach by different agencies 
towards the survey of the same subject-field using identical concepts, definitions and 
procedures. Different agencies collect data on ‘matching' samples drawn according 
to the same sampling design and process them using the same estimation procedures, 
thus obtaining comparablo and independent estimates which may also bo poolod 
together. Evon for the same agoncy the system provides for collection and proces¬ 
sing of data from matching (sub-) samples by different fields or other operating parties. 

Census versus sample survey 

9. It has been earlier pointed out that the preferred system is based on 
sample surveys and not on censuses (or complete enumerations). It is not even one in 
which the census on a particular subject forms the core for the statistical organisation, 
and sample surveys form the fringe. It is, therefore, interesting to find out the 
reasons which might have prompted the Professor to eschew complete enumeration 
from the frame-work of the NSS. 
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10 . It is well known that the Professor is a staunch advocate of sample 
surveys which he, very definitely, prefers to censuses (complete enumerations). This, 
however, should not be taken too literally ; that is, if I understand him correctly, 
it is not his intention to claim that the former is to be preferred to the latter under 
all circumstances. The conditions under which a survey, whether census or sample, 
is conducted are extremely important; and his preference for sampling is precisely 
because one can reasonably expect to create conditions in a sample survey which 
are definitely superior, from the point of view of cost, accuracy and timeliness, to those 
which can reasonably be achieved in a census. The above view on what can reason¬ 
ably be expected in a census and in a sample survey must, I believe, have reference to 
Indian conditions. For, if I remember correctly, I have heard him remark that it 
is conceivable that in some countries, for example, in some of tho smaller economically 
advanced countries or in some of tho socialist countries, the census conditions in res¬ 
pect of certain selected subjects of enquiry may not be so unsuitable. In any case, 
it appears worthwhile to enter into a detailed discussion on tho relative merits of 
census and sample survey in a country liko India. 

Sample survey (SS) as a substitute for complete enumeration (CE) 

11. Some like to look upon sample survey (SS) as a substitute, (usually in 
an inferior sense), for complete enumeration (CE). It is necessary to examine this 
point carefully. Suppose that adequate resources are forthcoming to carry out 
a complete enumeration (CE) for an enquiry about, say, agricultural holdings, more or 
less in the lines of what is commonly called an agricultural census. Should we have 
a CE of necessity, or could a sample survey (SS) serve the purposo as well ? 

12. There may be two types of situations. First, we have tho type whero 
tho major purpose of collecting statistical data is to study or supply information 
separately for each and every unit (holding) in the country. Here a census of all units 
is clearly indispensable. Then there is the second type where aggregate or summary 
figures arc required for a domain of study (for example, a natural division of the 
country) which happens to be an aggregate of a large numbor of units (holdings) of 
enquiry. Here is a case for taking tho sampling method also into consideration. 

13. For the second kind of situation, the information about any unit, in¬ 
cluded in the census or sample, is not, as in the first case, an end in itself, but is a 
means to an end. It enables one to obtain a valid estimate of the summary informa¬ 
tion of the domain of study. In the summary information, the separate identities 
of different units (of enquiry) are completely lost, and it is the summary information 
and not the information on each of the units which is sought after. Therefore, absence 
of information on some units, as must happen for units not included in tho sample, 
(or even imprecise information on some or all the units for which data are collected) 
may not matter, so long as sufficiently accurate summary information is obtainable 
for tho domain of study. This point is of fundamental importance for the proper 
comprehension of the role of sampling in the production of summary information. 

23 
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14. It may be felt that CE must be the best method, even for summary 
information, as it gives the ‘true' summary, whereas SS can practically never give 
the true value. Certainly, summary information is not needed for its own sake; it is 
to be utilised for some purpose. And. as general experience shows, what is adequate 
to meet the purpose is not the exact summary, but one approximate to it, provided 
it is sufficiently accurate. Now, sampling methods provide approximate information, 
so that, even if CE provides the true summary it is not the only method to be 
considered ; SS may also serve the objective equally well. It may be pointed 
out in connection with the use of approximate data that there is an inevitable 
gap between the reference date of the statistical information and the date on which 
it is actually used for certain policy decisions. Thus the user, in utilising the infor¬ 
mation for a past date, has to tolerate a certain degree of uncertainty in regard to 
the datc-of-use position, in which he might be strictly interested. 


Savings through use of sampling 

15. It generally happens that an SS providing summary result of just the 
desired degree of precision may demand substantially smaller resources than a CE; 
because, the 'last few steps’ in reaching the peak of precision, as one progressively 
increases the sample size ultimately to reach the level of complete enumeration, entail 
substantially greater effort, whereas a little lowering of the requirement regarding 
precision, which in fact can bo easily done in practice, makes possible substantial 
savings. The possibility of considerable savings by the adoption of sampling methods 
was amply demonstrated by the Professor in his pioneer work in the sample survey 
of jute crop in Bengal more than two docadcs ago. He had shown that, with only a 
small fraction of the cost for a census, reliable results on a sampling basis wore 
obtainable. 

10 . Incidentally, it appears that, when very little information is available on 
asubject, which is likely to happen in most of the under-developed countries, greater 
error may be tolerated, at least at the initial attempts at estimation. Larger the per¬ 
missible error smaller is the required sample and therefore greater is the savings duo 
to sampling. Again, the larger the total number of units in the aggregate for which 
summary information is needed, as it usually happens in a largo country, the greater 
the savings. The sampling method, therefore, enables the authorities to avoid 
wastage which would be involved in an attempt to produce by means of a CE too pre¬ 
cise estimates in a given subject-field when in fact such precision is not needed. 

17. The feeling, still prevalent in some quarters, that complete enumeration 
is the most desirable approach, and that sampling should be adopted only as o last 
recourse, has thus to bo examined carefully. Indeed, some authorities not having 
enough funds to carry out a complete enumeration, may be inclined to think that 
financial circumstances have forcer! them to accept the next best, namely, a sample 
survey. But on the basis of the principle, not to obtain too precise an estimate, 
they might find that for large domains of study, even if funds were available for a 
CE. a better choice would be to have an SS. as that would be at a lower cost. 
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Reconsideration of ‘need* for data ox small aggregates 

18. It is true that sampling methods cannot he profitably used if it is deman¬ 
ded that in addition to summary information for large domains of study, fairly prcciso 
results are also to be furnished for very small groups of units (e.g.. for small 
administrative divisions like villagos or for minor occupational groups). Then the 
desirability of having n complete enumeration may have to be examined. Now the 
magnitude of the difference in costs for ( 1 ) a CE with tabulation breakdowns for 
smaller aggregates, and (2) an SS where tabulation breakdowns are restricted to larger 
administrative divisions only is so large, particularly for a vast country like India, 
that careful examination of the fundamental question given below becomes almost 
imperative. Speaking generally this difference will be smaller for smaller countries, 
as a large number of economically advanced countries arc. so that the following ques¬ 
tion may not be quite so important for them. Now we come to the busic question— 
Are such detailed breakdowns really essential ; or whether it would not be more use¬ 
ful to obtain with the expenditure of the same resources. (1) a large variety of infor¬ 
mation on the same subject, or even on different subjects, for a small number of largo 
aggregates, as would be obtainable from an SS. or (2) a very small variety of infor¬ 
mation on only one subject but for a larger number of small administrative divisions 
(or other types of small aggregates), ns obtainable by C'E ? 

19. To consider the question dispassionately, one must got rid of any pre¬ 
conceived ideas about the information needed. It may be particularly difficult for 
any one stee|»ed in the tradition of complete enumeration to do so. because ‘wlmt 
should be’ is so ingrained in him already, that fresh and unbiased thinking may be 
difficult. It is extremely natural for a CE practitioner to 'want' figures by small 
administrative divisions, because ho cannot but help obtaining them during the course 
of his process of summarization for large administrative divisions, specially in a situa¬ 
tion where the normal official machinery at different administrative levels has been 
(or was initially in the first few censuses) pressed into service for summarization, 
each at its respective level, by primary methods of manual tabulation. Thus in 
the threo latest Indian population censusos with manual sorting data the ‘needs* 
at the levol of villages, which number raoro than half a million, shifted successively 
with identical needs for somo threo hundred and odd districts comprising the ontiro 
country. Thoso ‘needs’ changod from counts of persons belonging to different com¬ 
munities, through counts of persons with different moans of livelihood, to counts of 
workers by industry. 


20. It is natural for a country embarking on data collection on a new subject 
to look for guidance to those countries having previous experience as to what items 
of information and what geographical breakdowns and cross-classifications are likely 
to be of value. While this is an approach which is natural, the experience of others 
which are perhaps mostly economically advanced, must be seen in proper perspective! 

21. In countries with a census (CE) tradition the present information cove¬ 
rage, and the number and character of the domains of study had been arrived at by 
a process of evolution in which the 'need’ of the country concerned was the deciding 
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factor. It docs not. however, follow that for a country which does not possess 
such a tradition, the best course would also be to adopt the scheme to which this 
process of evolution had led. 

22 . First, the needs may be, and perhaps are, different; and the difference 
is likely to be large when a developed country is compared to an under-developed one. 
Secondly, the techniques of obtaining statistical information available at the present 
time, were not available earlier when the countries with a census tradition started 
their programme of data collection. Their present ‘needs’ have evolved from their 
earlier ‘ needs’ which were no doubt coloured by what the methods (complete onumera- 
tion/manual tabulation) at the time could produce with facility. It may even be 
that they have now reached such a stage of economic development, or that the supply 
of data by small administrative divisions, for example, has itself created such 
a demand now that such data are now really needed with high priority. It must 
be pointed out in this connection that availability of large resources makes an other¬ 
wise low priority information sufficiently important for inclusion. From this point 
of view what is sufficiently important for inclusion in an economically advanced 
country may not be so in an under-developed one. 

23. It may, on the other hand, be also true that traditions arc hard 
to change, and countries with census tradition might not have been able to get ovor 
this difficulty even when unbiased thinking goes against such tradition. It does 
not follow, therefore, that, since some of these countries have not switched over to 
SS, the information coverage and geographical breakdowns appropriate to a CE is 
necessarily the best in all situations. There is a strong case for reconsideration of the 
‘need’ for information about small aggregates. 

24. It is not always an easy task to exercise one’s judgement in the abovo 
question. But certain facts may have a deciding effect. If, for example, tho cost 
of producing results for smaller aggregates is dimensionally of a different order (neces¬ 
sarily higher), as it obviously happens for a vast country like India, then there is a 
strong case for going in for summary information only for larger aggregates. Consi¬ 
derable 'savings’ thus effected may be utilised to collect data on some additional 
but relevant items of information in the same subject-field. But the economically 
under-developed countries may find that they can ill afford to utilise the entire 
‘savings’ just on increasing the number of items of information in the same subject 
when important gaps exist in other fields. Thus the question of assigning priorities 
to different items within the same subject-field is replaced by the multi-subject 
problem of allocation of‘savings’ to different subject-fields. In the extreme situation, 
which is more likely to happen in a country like India, for most of tho subjects, 
there may not be any question of ‘savings’ since the expenditure on a CE may bo 
unthinkable. 

25. Even without a CE village studios may be possible. Although sampling 
method may not be feasible for the production of estimates for each and every village, 
yet it may be utilised for studies in which the village is the unit of analysis even 
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when it is not the unit of data collection. Particularly when multiple subjects arc 
covered in a single sample survey operation, it may not be a costly proposition to 
collect necessary data to estimate from a probability sample of villages ( 1 ) the propor¬ 
tion of villages, for example, with educational or market facilities, where, village is the 
unit of data collection, or ( 2 ) the frequency distribution of villages in various ranges 
of death rates which are to be derived from information about deaths occurring in 
a sub-sample of households located in the sample villages. The Professor is a great 
enthusiast for the production of such 'village statistics’ continuously so that a watch 
may be kept on the progress made in the rural sector, such progress being expected 
to be rather quick due to plan efforts. 

26. Tho Professor, if I understand him correctly, doos not moan that no kind 
of census for small areas should have a place in our statistical systoin. It would appear 
that he appreciates tho possibility of administrative need of small area statistics of 
a very few specially selected items liko geograph ical/cultivatcd area and number of 
houso/housoholds or population. However, if my impression is not mistakon, oven 
for items liko cultivated aroa he is of tho viow that purely routine aggregating of minor 
area statistics, without adequato checks, is not usually capablo of supplying infor¬ 
mation of sufficient accuracy for policy decisions at the national lovel. 

27. For the implementation of some schemes it is conceivable that avail¬ 
ability of information, at the village level, may not bo adequate. Data even at the 
level of individual household, person, holding or establishment etc., might also bo 
necessary. Still the need of a census in all theso cases requires closer examination. 
The geographical coverage of a scheme may be much less than the census coverage 
which is ordinarily nation-wide. Thus expenditure on a dotailed census of the non¬ 
scheme portion of the country seems avoidable ; at least, it should not have such 
high priority. Again, there is a time-interval, usually uncertain, between census 
taking and date of implementation of a scheme. In the use of census data ono 
has, therefore, to face the difficulties for changes over time. It should be remem¬ 
bered in this connection that, relatively speaking, smaller aggregates and individual 
units are subject to greater changes than larger aggregates. The individual units 
may even cease to exist, completely or at least at the original location, and new 
units may also crop up. It appears, therefore, that a better course would be for 
the implementing authorities to carry out a quasi-census type of enquiry when¬ 
ever and wherever needed. The quality of this work need not perhaps be high, 
because omissions and commissions will be spotted automatically in course of 
implementation ; moreover affected parties are likely to point out the mistakes. 

28. In some countries population census taking is a constitutional necessity 
for representations in the legislature. This provides an opportunity of constructing 
a sampling frame; and selected statistics for small geographical areas, like villages in 
India, are extremely useful for stratification, probability of selection and estimation 
in a sample survey. We shaU have further discussions on this aspect in the section 
on sampling frame. 
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Interdependence of needs and techniques 

29. In the previous section we have concentrated on the need for data 
on small aggregates. We propose now to deal with the fundamental approach to 
the question of the choice of data and its relations to the method of collection. 
Obviously only the data required should be obtained. But the term 4 requirements’ 
is rather difficult to define precisely. One may attempt by saying that anything 
that is useful is a requirement. But there is almost always someone who will 
declare that any given item of information on the subject of interest is likely to be 
of some use. but others may differ. Obviously this is not a very helpful situation. 

30. For any attempt to secure the most useful information coverage, one 
must remember that the basic question is not whether a particular information is 
needed or not, but whether information A is more needed than information B. It 
is probably somewhat easier to come to some general agreement as to whether a parti¬ 
cular information is more or less useful than another. Here again opinions may differ 
to some but, possibly, less extent. In a practical situation however, where a decision 
is to be taken one has of necessity to depend upon the verdict of a ‘competent 

authority.’ 

31. But the above is a somewhat over simplification of the real situation, 
because the practical question is whether in relation to the expenditure (of resources), 
information A is to be preferred to B. Arrangement of different items of information, 
by priorities arrived at without any reference to costs even if possible as assumed 
in the previous paragraph, is not of much use. It may so happen that B may bo 
considered to be more needed than A (costs being no consideration), but expenditure 
on B may bo so large compared to A that the latter may be preferred. In short, 
the verdict may be that it is not worthwhile incurring so much expenditure on B. 
Some may like to look at the problem from a slightly different angle. With a given 
volume of resources, it is possible to obtain alternative sets of information. Which 
particular set is the most useful ? The method which furnishes the most useful set 
of information is to be preferred. Here it is important to emphasise that not only do 
the needs affect the choice of technique or method, but the technique or method also 
affects the needs. Needs and methods react upon each other ultimately converging 
towards a decision which favours a particular need and a particular method. 

32. Preferences are governed by the expenditure, and this in turn depends 
upon the technique or method employed. In a comparison of two methods it would 
not be proper to judge their relative merits on the basis of the ability to do certain 
things, when these are fixed in relation to only one of the methods. A valid compari¬ 
son, if possible, can only be done when the two methods arc tested in the types of 
work for which they are respectively best fitted. It would, therefore, be wrong to 
reject the sampling method just because it may not provide sufficiently precise esti¬ 
mates for small administrative units which CE may possibly do, (although oven here 
there may be serious doubts because of non-sampling errors, as we shall sec later on). 
Similarly, it would be wrong to reject the latter merely because it cannot furnish 
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a larger variety of data (for larger divisions) within the limit&tioas of a given budget. 
One should not summarily reject method A as it cannot produce what method B 
can. because it may so happen that method A can produce certain things which B 
cannot, and what it can produce may on the whole be more valuable than what B 
can. Our preference for sample surveys is based on the above criterion. 

Non-sampling errors and rational behaviour 

33. Our discussions have so far been based on the implicit assumption that 
errors, if any, ar» due only to sampling. This, however, is a very unrealistic assump¬ 
tion, because there are other quite important sources of error. Errors in the ascer¬ 
tainment of information from a unit of enquiry and those arising at the processing 
and tabulation stages are quite important. This was realised by the Professor long 
ago when he was developing sample survey methods. That the results from a com¬ 
plete enumeration are also subject to such non-sampling errors should not bo lost 
sight of in the planning of a statistical survey. 

31. Would one consider the decision to Ik* rational if the resources arc 
very largely utilised to control or even to eliminate one type of error ? Would 
it be rational to ignore the effect of other sources of error t For example, should 
we utilise our resources mainly in an endeavour to cover each and every unit in a 
population or aggregate, in order to control the sampling error to the point of elimi¬ 
nation. or should we not go quite so far ; that is, should we use a sample and leave 
some resources to control the other sources of error ? 

35. It is rational to consider both types of errors, sampling as well ns non¬ 
sampling. and utilise the resources to control both of them in such a manner as to 
reduce the total error to the minimum, or. rather to the desired level. In a census 
(CE), sampling error is eliminated completely, but often not much attention can 
be given to non-sampling errors. 

36. In the sequel we shall continually come across situations where the 
choice among alternatives is very highly regulated by considerations of non-sampling 
errors. Such errors occur almost at every stage right from the planning of the survey 
to the final production of end results. 

Non-sampling errors and sampling 

37. A completely new line of thought which sampling has evoked is. surpris¬ 

ingly enough, about errors arising from sources other than sampling ; that is, errors 
in the ascertainment of information from the units of enquiry, and in tho processing 
of such data. It may appear paradoxical that most of the practitioners of sampling 
should be advocating, so to say, the need of introducing a little sampling error in 
order to reduce considerably the non-sampling errors; or rather to reduce tho total 
error, which is the joint product of both sampling and non-sampling errors Tho 
Professor has been foremost in the propagation of this idea which must have taken 
root when he endeavoured to grapple with the problems of a successful sample survev 
in the thirties. J 
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US. How is non-sampling error affected by the sample size ? The effect, 
if any. can only be an indirect one. The quality of the collected data depends, among 
other things, on the inherent ability of the investigators or enumerators, their train¬ 
ing and experience ; and also on the quality and intensity of the supervision of their 
work. This holds good for processing work also. The greater the size of the sample, 
I he greater will be the volume of work, both for data collection and data processing, 
and therefore the greater will be the requirements of field and processing staff. Now, 
the average level of the best available thousand ( 1 . 000 ) investigators, for example, 
will be less than that of the best available hundred (100). Hence, the largor the size 
of the sample, the less will be the average ability of the staff, and the more expensive 
will be their training and supervision. The level of the supervisors will also fall off for 
similar reasons. Moreover, contacts of the topmost supervisory staff with the enu¬ 
merators will grow remoter with the necessity of introducing new intermediate stage 
supervisors. All these will increase the incidence of non-sampling errors. 

39. The above point is particularly important for undor-dcvelopod countrios. 
On the one hand, these countries arc in need of more able and specially trained investi¬ 
gators to elicit the required information, because the general economic, social and 
educational level may not facilitate the collection of as accurate data as is possible 
under the more favourable conditions of the developed countries. On the other 
hand, there may be so few experienced and qualified persons that the average 
ability falls off very quickly with the increase in the field strength. 

•10. The difficulty of organising and managing largo scale processing work 
is also relevant. If the sample size is increased, say. ten-fold, then, because of the 
increase in the volume of work, the organisation of the operational part will bo com¬ 
paratively more difficult, with the net result that the estimates would be subject 
to larger gross errors. 

41. With the knowledge and experience available at the moment, one may 
perhaps hazard some general observations. Without attempting to bo too precise, 
we may argue that non-sampling error increases with increase in sample size, and 
therefore for cent per cent sampling (i.e.. CE) the non-sampling error is relatively 
largest. 

42. It is not the sampling fraction, but the actual sample size which affects 
the absolute magnitude of non-sampling error. An agricultural census (CE) of a 
country with a large number of agricultural holdings will be subject to higher error 
compared to another where there is a substantially smaller number, (other conditions 
being assumed to be similar), even though in both the cases the sampling fraction 
(viz.. 100 per cent) is the same. This is of particular significance for a country like 
India where the population is large and where there are a great number of agricultural 
holdings. In India, therefore, the errors on this account may be expected to be large 
compared to that for a small country if CE is attempted at both the places. 

43 . The sampling error decreases comparatively rapidly in the initial stages 
for each unit increase in sample-size, but after a certain stage the decrease becomes 
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an extremely slow process. However, for non-sampling errors it would a|.|»c»r 
from practical experience that the situation is just the opposite. Such errors 
(including operational error) are small when the sample size is small, ami increase 
rather slowly (luring the initial stages, but later on. they increase rapidly, and |m>ssiM.v 
at a tremendous rate if there is sco|>e for very large increase in the (absolute) size 
of the sample. This last possibility exists only when the population is large and 
therefore, large non-sampling errors arc likely for censuses on most of the subjects 
for a vast country like India. The combined e ffect of sampling and non-sampling 
errors on the total error as the sample size increases, is first a trend towards a decrease, 
but. after a certain stage, an increase which may Ik* quite rapid for large populations. 
Thus to obtain an estimate of maximum accuracy, which occurs at the turning point, 
one should not have CE but SS of appropriate size. It is likely that this turning 
point is higher and is reached much earlier in economically and statistically under¬ 
developed countries (with larger non-sampling errors) than in the advanced countries ; 
moreover, the rise is steeper in the case of former countries. The ease for sample* 
survey (SS) is thus stronger in umlcr-dcvclo|>ed countries. 

44. From what wo have said above it is clear that when non-sampling errors 
increase rapidly with increase in sample size it is specially important to explore all 
avenues of reducing the sample size in order to obtain more accurate estimates. Gene¬ 
rally speaking, reduction of sample size may mean reduction in some of the non- 
sampling errors but it will also mean increase in sampling error, unless improved 
sample designs are adopted. It would, therefore. up|>car that in under-developed 
countries special efforts towards improvement of sample design are doubly worthwhile. 
Continuing research is desirable; this is possible in a permanent organisation, and this 
is one of the characteristics of the system which the Professor has preferred. 

Factors peculiar to under-developed countries 

45. To appreciate the role of statistical surveys in conditions similar to that 
of India, some comparisons with situations obtainable in economically advanced 
countries may Ik* relevant. Under developed countries havo their own peculiar 
conditions, and. while taking advantage of the experience of advanced countries, they 
should none-thc-less guard against acceptance of any scheme which does not take 
full account of the conditions obtaining in their country. It may be pointed out in 
this connection that Professor Mahalanobis, as is well known, is a person whose out¬ 
look is extremely progressive and he is the last person to reject without proper con¬ 
sideration any idea just because it is foreign. But he is at the same time very critical 
about blind copying of the economically advanced countries. 

46. We shall now describe the conditions in an under-developed country 
as exemplified by conditions in India. There are several special factors to be reckoned 
with. On the debit side, the economy is unorganised and subject to very large sea¬ 
sonal fluctuations, since it is largely agricultural. Agricultural produce, particular^ 
food crops, are wholly or partly used for home consumption. Conceptual, definitional 
and measurement problems in the under developed countries may be substantially 
different from those in other countries, and are generally more complex as 
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for example, those connected with the question of unemployment in the rural areas, 
where there is no labour-market of the western type. The common man, mostly illi¬ 
terate. is uninitiated in modern business and other terminologies, (which may not 
present, relatively speaking, any great difficulty of comprehension to people in 
advanced countries), and there is considerable scope for errors of ascertainment. 
Record keeping is more an exception than the rule. Disentanglement of house¬ 
hold and business expenditures and activities, separation, for example, of trading 
from manufacturing activities etc., present great difficulties. Marginal cases are 
more frequent and errors of classification arc higher. There is a great scarcity of 
qualified and experienced personnel in the field of statistical surveys. Modern tabula¬ 
ting equipments are not readily available, and are costly compared to the general 
economic level. Transport, communication and camping facilities arc not fully 
developed. Population, mostly rural, is widely scattered and the advantages of 
the great majority of the population residing in concentrated urban or semi-urban 
areas os obtaining in advanced countries are unavailable. Even medium sized towns 
are rural according to advanced standards. 

•17. There may be a lack of adequate sampling frames and substantial ex¬ 
penditures may be involved in emending whatever are available; oven construction 
of frames may be needed. Complete listing of households of entire villages or hamlets, 
a costly affair, has to be adopted in household surveys, no detailed maps enabling direct 
selection of very small population segments being possible. Current records or statistics 
which may help to achieve more efficient use of resources by bettor methods of sampling 
and of estimation may bo mostly lacking or extremely deficient. In India lack of 
mobility, economic, social and physical, has perpetuated more or less the traditional 
differences. There are wide disparities from household to household, from villago to 
village, from region to region, and the variability is high. To a western eye the varia¬ 
tion (standard deviation) may appear to be low as the general ‘level’ is low compared 
to the standards with which he is familiar; but what matters is the variation rclativo 
to the average ‘level’ (coefficient of variation), and this is high. 

48. On the credit side. ]>cople arc mostly hospitable and the investigator or 
enumerator has not to face as much camping difficulties and expenditures as ho 
would otherwise have to. The informants are cooperative, less sophisticated, less 
mobile and their life is very simple compared to their counterpart in the more 
advanced countries; all these factors go towards better quality of data. Perhaps a 
greater margin of error can be tolerated in a large number of subjects, partly because 
of the absence of any worthwhile data on these subjects, and partly because the eco¬ 
nomy is still so primitive that at the present stage very accurate data may not bo 
essential. There is greater scope for savings by integrating two or more subjects of 
enquiry, because, unlike the advanced countries, there may not already be two or 
more departments each dealing regularly with a different statistical survey, and 
therefore the extremely difficult problem of bringing them together may not arise. 
Moreover, such savings may be considerable since the economy is basically a house¬ 
hold economy, and there is greater scoj>c for closer integration of different enquiries, 
since the entry in each case may bo the household. 
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Questionnaire versus schedule of enquiry 

49. In an under-developed country with it* peculiar difficulties it is important 
to consider whether to use a questionnaire or a schedule of onquiry. A questionnaire 
gives a list of questions which, strictly speaking, an enumerator is expected to repeat 
vorbatim before the respondent, and he is expected to note down the responso of tlio 
informant. The schedule of enquiry, however, merely indicates which items of 
information are to he collected by the enumerator or investigator; the exact questions 
have not boon standardized, and tho mothod of questioning and putting suitablo 
probing questions, which are to be framod by the investigator according to tho exigen¬ 
cies of a particular case, are left to tho discretion of the investigator. A questionnaire, 
seemingly so, should be regarded as a schedule if tho investigator is givon considerable 
latitude for asking probing and confirmatory questions at his choice. In India there 
are also special difficulties arising from the non-existence of a commonly understood 
language. There are a variety of languages and innumerable dialects; to draw up 
questionnaires which are exactly equivalent in these languages and dialects at a central 
place is extremely difficult. Tho feasible proposition is to train up the field staff 
in English, which is commonly understood by educated persons in India, and leavo tho 
questioning in appropriate languages to the investigator. (In tho above context it 
is significant that the term investigator is commonly used in India in preforonce to enu¬ 
merator). 

50. It may appear that tho schedule method is subject to good deal of investi¬ 
gator bias. This would be so if ad hoc lay persons were engaged on data collection. 
But with the permanent experienced wholotime statistical staff, which tho preferred 
system enjoins, things would be different. Excepting for a small number of very 
simplo (according to ‘under-developed’ standards) items of information, the naturo of 
all othor items in which ono may be interested is such that the informant may find it 
rather difficult to comprehend them exactly. Thus without elaborate explanations 
he may not bo able to supply the required data. The socio-economic conditions are 
of such a nature that the informant has generally no clear-cut and standard notion 
of what is conveyed by a term like gainful activity or unemployment, particularly in 
rural areas. His way of thinking may be completely at variance with what is desired 
of him. Even in respoct of such an item as age, the respondent may have, at best, a 
vory vague idea, and a good deal of probing will be necessary. The informant does 
not usually keep a written record of his activities even when theso are business acti¬ 
vities. The investigator must be sufficiently trained and experienced to ask auxiliary 
questions which will help the informant in the process of recalling the correct facts. 

51. It is not generally possible, at the outset, to visualize, while drawing tho 
questionnaire or schedule, all the possibilities which may exist in a country. In any 
case, even if it were possible, tho list of questions would be so long for any fairly com¬ 
prehensive enquiry that a large number of thorn would bo irrelevant to a particular 
situation, and their asking, as one strictly should do in a questionnaire system, can only 
create confusion and irritation, and tho very object of putting probes would be lost. 
It, therefore, becomes necessary for the investigator to select suitable probes, depending 
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upon the circumstances of the case. It is true that the schedule itself should provide 
for a very few selected items of a probing nature which are of frequent applicability, 
>ut these may not always be adequate. It is also important to point out that even 
m the sa,ne locality the socio-economic, literacy (educational) and cultural levels of 
the respondents may differ so widely that to elicit correct information, excepting for 
very simple items, the approach, the manner of questioning and the exact questions 
must differ from informant to informant. When the questions are familiar to ordinary 
people and convey some standard meaning, it is admirable to use standard questions; 
when, however, this is not the case, it may be worthwhile to fall back on the schedule 
system. 


Type of investigators 

f>2. If the peculiar difficulties in the economically under-developed country 
like India are borne in mind it need hardly be pointed out that investigators or enu¬ 
merators of high ability are needed. Thoy must bo trained in such a way that to 
elicit the desirod information reasonably accurately thoy can keep the objective of a 
detailed economic or other enquiries in view and arc in a position to framo indepen¬ 
dently, whenever necessary, suitable probing questions which would necessarily dopond 
upon individual circumstances. It would appear that their level should bo somewhat 
higher than thoir counterpart in the economically more advanced countries using the 
questionnaire method. This is really a very difficult situation; on the one hand, 
because of the unfamiliar and difficult concepts, definitions and procedures and for 
other reasons, it is necessary to have superior investigators, on the othor hand it may 
not be easy to find many investigators of the desired level. 

r>3. In a large number of enquiries, then, specially those which are not ex¬ 
tremely simple, it may not be possiblo to secure the services of sufficient number of 
competent investigators if it is desired to carry out a complete enumeration. It will, 
therefore, be necessary to explore the possibility of carrying out a sample survoy with 
a small but highly efficient batch of investigators. 

54. In the caso of very simple enquiries, normal governmental machinery 
may be employed. Innumerable officials, who arc already posted at difforont locali¬ 
ties throughout tho entire country in connection with thoir normal duties, may be 
engaged in tho sample survoy which ono may like to undertake. Such government 
officials are not likely to loave government servico and thoroforo casualties on this 
account will bo rare. Naturally, in such a situation, such enumerators may havo to 
work only on a part-time or on a very temporary wholc-timo basis. Ono of tho obvious 
advantages of this scheme is that, not much travelling would bo involved as an enu¬ 
merator would ordinarily work in his own locality. Thus travel costs aro very much 
reduced compared to a system with permanent wholo-time investigators, who aro 
necessarily smaller in number and are to be fully ongaged over a longer survey period. 
Each of them has to cover a larger number of points, spread over several localities, 
and therefore havo to incur higher expenditure on travelling. It may, however, be 
pointed out in this connexion that, if these seconded official enumerators have to come 
to a central place for training, tho total travel cost would bo substantial, specially 
because of large numbers. 
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55. Synchronised enquiry at different localities throughout tho country may 
not be possible, particularly when tho officials arc to ho engaged whole-timo for a short 
period, as they may not all bo spared from other work at the same point of time. 
There would be other difficulties as well, because other important assignments have 
to be neglected during training, and so. it can only l>c for a very short but inadequate 
period. This system may possibly be used when all the officials are simultaneously 
free and the nature of enquiry is so simple that the training can bo imparted by corres¬ 
pondence or in a very short training conference organised at several centres by persons 
already posted there on somo other official business and who thomselves do not require 
any elaborate training at a central placo. 

• r »6. The quality of work of such an official enumerator oven for simple 
enquiries may not always be fully satisfactory because his main interest is not in the 
statistical survey but in some substantive appointment of a different nature, and close 
supervision of his work may not be there for similar reasons. If the investigating 
official and/or his superior officers are under the impression that the survoy work is 
only a minor part of their duty, and good performance in this work will practically go 
unappreciated, tho work may suffer. A statistical authority may not liko this kind of 
arrangement, because the investigating staff may not be placed directly under his 
administrative control, so that he will be vory much handicapped in taking suitable 
administrative steps to improve the quality of the survoy. Placement of tho staff 
under such an authority on temporary but whole-time basis may improve matters to 
some extent, but such arrangements are not likely to bo favoured by the parent depart¬ 
ment. This state of affairs leading to unsatisfactory performance of work may be 
rathor pronounced in tho case of ad hoc surveys. However, if the survey is of a conti¬ 
nuing nature and tho local official enumerator is appointed more or less pormunontly, 
oven though on a part-time basis, with suitable additional remuneration expressly for 
the purpose, thon the enumerator may have a certain interest in performing his survey 
work at least with that amount of efficiency which would not entail a discontinuance 
of tho part-time assignment. But even this may not bo so if he finds himself irreplace¬ 
able due to non-availability of a second qualified person in the locality which is not 
always unlikely. 

57. In this system with a large staff of part-time enumerators there may 
not bo much scope for selection even if such a selection is oxtended to qualified 
non-officials. In an under developed country like India sufficient number of qualified 
people, even for a very simplo enquiry, may not be available in overy locality. In 
fact, there will be many sample villages where not even a single teacher or other edu¬ 
cated porson may be found. Ordinarily a large number of part-time enumerators, 
(mostly irreplaceable, particularly at short notice), scattered fairly apart in an area of 
poor communication facilities may have to be engaged, and administrative arrangements 
and control may bo a difficult job. There may be a large number of casualties arising 
from failure to arrange for a reserve. Untimely receipt of information about the sudden 
inability of the part-time enumerator to do the job due to some urgent developments 
in his normal duties, transfers, or illness may result in incomplete surveys. 
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•»S It may be felt that a local' official, bocauso of his familiarity with the 
ocality is hotter suited for survey work. It is. however, doubtful whether more know- 
e< ge° I le locality will balance the drawbacks of not undergoing any intensive train¬ 
ing as this cannot be organised efficiently for such officials. If the type of information 
is m some way connected with his substantive work then the position may bo better, 
pirn 1 e< he can allay tho informants' suspicion, if any, that such information, 
although related to tho subject matter of his normal work, has no chance of being used 
V the official in a manner which may put the informants into some pecuniary or other 
disadvantage. To ensure this may not bo an easy task. Granted this, ho is in a posi¬ 
tion to secure better co-operation of the inhabitants and with his local knowledge 
is m a bet ter position to guard against some of the pitfalls. On the other hand, it may 
>e that such familiarity on the part of the enumerator may cause him to bo over¬ 
confident with the result that he may not- even be conscious that he is recording in¬ 
accurate information through inadequate enquiry. It is moreover conceivable that 
for certain items of information a household may have serious objection to give tho 
correct information to a local person, even when he happens to be a non-official, say, 
a village school teacher, although his attitude may change when the investigator 
happens to be a stranger. 

59. L’o reduce costs, instead of engaging whole-time people it is some¬ 
times planned to engage, on a part-time basis, non-officials who are already omployod 
elsewhere because such persons may agree to work on a small allowance to supplement 
their main income. But difficulties may arise. They may at any moment, leave their 
survey job or do it in a slip-shod manner whenever they are hard pressed for time duo 
to other reasons. Their depondonce on this part-time job is so small that slightest 
personal inconvenience may prompt them to resign at short notico. 

60 . 'I'he main snag, however, in the employment of such a large number of 
part-time enumerators lies elsewhere. Experience shows that it is not possible to 
collect accurate data if the type of information is comparatively more complex, 
as it is likely to be in a large majority of cases in which the country may be interested. 

It is, therefore, necessary to examine the quest ion of engagement of whole-time staff 
either on temporary or permanent basis. 

61. Purely temporary appointments of non-officials even though on a wholo- 
time basis may create difficulties. These people may not have any other important 
source of income and, naturally, they leave the survey job as soon as they secure a 
permanent one, or a temporary job of longer duration. And specially when the survey 
is about to be completed they may slacken their attention on the survey work in order 
to search for a new job, even if it bo purely temporary in nature. 

62. One may expect a fundamental difference between the performance of in¬ 
vestigators working on a permanent whole-time basis and those working on a different 
basis. In appointing such permanent staff one is not handicapped by the constraint 
that only local officials or local educated persons are to be engaged. It is true that such 
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restrictions need not also be observed if it is planned to conduct an ad hoc survey by 
temporary whole-time staff. But such temporary appointments may fail to attract the 
most competent persons, as permanent whole-time appointments would. Moroovci, 
permanent staff with their ever growing experience Is in a better position to elicit the 
desired information more correctly and expeditiously. The expenditure involved 
in maintaining permanent whole-time staff is greater than that for a system with part- 
time workers, like teachers. In case of whole-time but temporary survey staff, how¬ 
ever, the difference may not be as great. Being inexperienced thoy require longer 
training than experienced permanent staff, and expenditure on that account may be 
higher. In any case reduction in costs should not be at the expense of accuracy. 

03. Survey work in a selected unit, is almost always such that it cannot bo 
indefinitely postponed. Difficulties, therefore, arise from resignations of investigators. 
To create such employment conditions that people do not so easily leave the survey 
work is, therefore, worth serious attention, and permanent appointment is obviously 
ono such condition. Resignations from permanent appointments usually require 
longer notice so that the survey organisers are in a bettor position to arrange 
for a substitute in time. In caso of ad hoc surveys with temporary whole-timo field 
staff it may be particularly difficult to arrange for a very short-term appointment 
as would be necessary if the resignation happens to bo at nearly the end of tho survey 
period. There is no such question in permanent appointments for continuing surveys. 
Unlike tho part-time system described earlier it is not necessary to select reservo 
investigators from local people, and therefore it is casior to create tho pool of reserve 
staff who can bo moved quickly from ono place to another. They can be used not 
only to fill up any gap in the main survey operations but can also bo engaged in spare 
time on miscellaneous auxiliary jobs which a survoy organisation always has. 

64. A system of whole-timo permanent cadre of investigators is, in a sense, 
self-corrective. A person appointed as an enumerator for a very short period may 
somehow complete his job even when ho does not like it; quality of work done under 
such conditions cannot bo high. On the other hand, ono cannot stick for a long time 
to an investigator’s arduous job of long duration as a permanent ono is, if it is very 
much against his liking. But there is also one serious danger; it will happen that a 
substantial proportion of persons who are able in survey work may also bo able in 
general, and some may opt for more remunerative work, whereas those who are 
of poor ability will find it difficult to find a job elsewhere and would stick to the 
investigator’s job. This is a real danger ; their continuance in survey work may 
help them to improve somewhat but a better course would bo to weed them out 
during a probationary period. However, taking all aspects together, the creation of a 
band of permanent whole-time investigators is essential for high quality data and the 
decision of the Professor in favour of this has been undoubtedly the proper one. 
Of courso, such gonoral purposo staff cannot be expected to collect roliable data for a 
specialised survoy requiring high technical or professional knowledge or skill in the use 
of delicate instruments. 
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Xked for permanent survey organisation 

b». In a sample survey one has obviously to minimise the sampling error, 
and fortius, research in sampling design, estimation procedure etc., is very important. 

Ut as has boon P° ,nted out Previously, mere elimination of sampling error does not 
necessarily secure accurate data. Special studies are necessary to assess and control 
various types of non-sampling errors, both at the Held and tabulation stages. Improved 
methods ot assessment and control are to be devised. Special studies are also neces¬ 
sary to solve the difficult conceptual, definitional and measurement problems 
associated with an unorganised economy and, in general, with the development 
oi suitable survey and processing techniques. Time and cost studies are of basic 
importance. Problems of programming both at field and tabulation levels are to be 
adequately resolved and continually improved, so as to make the fullest use of all 
types of available resources. Imbalances in various types of tabulation resources 
arc to be assessed and removed. Sampling design and estimation procedure may have 
to be changed or modified to fit in with any long standing or temporary shortage of 
any particular tyi>e of equipment. From a long range point of view the possibility 
ot using advanced data processing equipment (computers) are to be kept in view. 
1'iom the nature of these problems it is clear that a permanent sample survey 
organisation is best fitted to carry out these important functions. 


06. In a sense the most important advantage of a continuing organisation 
is that, it is in a position to build up competent and experienced staff—technical, 
field and processing. This is particularly important in a country like India whore 
persons with requisite knowledge and experience are in very short supply. In fact 
this point was realised quite early by the Professor and he took special steps to conduct 
theoretical courses in various aspects of sample survey, side by side with practical 
and in-service training in actual survey operations, both field and processing. 

07. The experience gained by a permanent organisation in earlier and current 
surveys helps not only to formulate and detail out the technical and operational 
questions properly, but also to explore suitable methods of tackling them. In an ad 
hoc survey even when such problems are faced and an immediate solution is not 
forthcoming, there is no incentive for finding a solution, because there is no prospect 
of its use in future. Things are different for a permanent organisation. Now problems 
continually arise, solutions of old problems may be improved upon, problems likoly 
to occur in future may be anticipated and worked upon. This may moan not only 
more efficient surveys but also more expeditious commencement and completion of 
surveys. The experience gained by tho staff and the training imparted to investi¬ 
gators and others are not lost, because they continue in tho organisation; tho experi¬ 
ence which they continually accumulate contributes to the improvement in tho quality 
of tho end results. Sustained studies are necessary to improve tho sampling design, 
and, with a permanent technical staff, this can bo better achieved. A permanent 
organisation is in a better position to evolve suitable controls at all stages of data- 
colloclion and processing, an important consideration in undor-dovoloped countries. 
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68 . It is not always simple to give proper instructions to field and processing 
workers. These should be free from vagueness, ambiguity and faults about proce¬ 
dures, definitions, etc. An experienced organisation is in a position to minimise sue» 
defects. In certain cases errors may be detected only after the survey and piocos 
sing are over. In these situations one can take advantage of such experience ior 
taking necessary procedural, supervisory or other precautionary measures for a future 
enquiry into the same or some connected subject or item of enquiry so that the 
incidence of such errors may become smaller. Analysis of data in certain directions 
may not be found worthwhile, similar analysis may not bo repeated in iuturo. On 
the other hand, absence of information on some vital items may make the collected 
data less useful. .Such a deficiency may be removed in later surveys. Again, thero 
may bo some indirect benefits also. It may be found from the survey of earlier rounds 
that expenditure of resources, say, on a search for certain errors are not worthwhile 
as the incidence of such errors is rather small. The discontinuance of such stops in 
subsequent rounds and its replacement by more useful work (o.g., scrutiny work whore 
it is really wanted) may be worthwhile. 

69. In the section on type of investigators wo have explained some of the ad¬ 
vantages of having permanent full-time staff. Another advantage of having permanent 
investigators is that they can be oxpocted to collect data with reasonable efficiency— 
when they aro called upon to deal simultaneously with more than one subject in a 
round, particularly because a majority of them are already 'old workers with earlier 
experience in the same or similiar subject-fields. We have explained elsewhere why in 
our view a multi-subject approach is desirable; however, in order to be successful, 
permanent field staff is an ossential pre-requisite for this approach. 

70. A permanent organisation with wholo-tiine field staff spread all over the 
country is in a better position to meet expeditiously any particularly urgent need for 
information. Indeed in the Indian NSS it has not been a rare experience to intro¬ 
duce some additional items of urgent information the noed for which was felt only 
after the commencement of a round. We have a system of sub-rounds so that by 
restricting this enquiry to later sub-rounds it is possible to canvass this additional 
information on a fully valid sumplo. With permanent fiold staff with experience in 
various subject-fields it will not be difficult to collect without any special training 
any additional information unless it is very different in nature from the other fields 
in which they aro already familiar. 

71. Another great advantage of a permanent organisation is that one can 
conduct extensive oxploratory/pilot studios in earlier rounds under normal fiold and 
operation conditions with the usual dogreo of supervision before taking up the full- 
fledged enquiry,. This is possiblo when the survey is on a continuing as well as on a 
multi-subject basis. Any such study taken up independently in a restricted region 
under close supeivision is not so useful if for. examplo, non-sampling errors undor 
normal operational conditions are specially to bo kept in view. It must be remembered 
here that tho nature and magnitude of non-sampling errors depend very much on the 
operational conditions and also on tho characters of tho area and population covored. 
Such pilot studies are also of the importance for designing of full-fledged survey as it 
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provides valuable information about various components of costs and variances, which 
may vary substantially from region to region in this vast country. 

72. Countries with meagre resources can ill afford to tolerate largo uncertain¬ 
ties m the estimate of total costs of a projected survey, nor can they have an inflated 
budget to cover up unexpected but essential expenditures. Cost components, neces¬ 
sary for the estimation of total cost on a specified enquiry, may be available from pilot 
studies. Even in the absence of such studies some ideas may be obtained from surveys 
of a similar nature conducted in earlier rounds. A permanent organisation can and 
should, therefore, keep records of various cost components, not only for field work but 
also for processing. These may be utilised in planning future surveys and in drawing 
up feasible tabulation plans. In regard to variances also studies made in earlior 
rounds will bo helpful. 

73. Nothing can bo more undesirable than starting a survey only to find 
later on that it cannot be carriod through because the earlier estimates of various typos 
ot requirements happen to be quito off the mark; this may happen when such esti¬ 
mates are mere guess-work or are not based on sufficiently reliable data. The work¬ 
load for each investigator is to be fixed in such a manner that survey work may bo 
completed in the scheduled time, and for this purpose estimates for various compo¬ 
nents of time requirements aro necessary. There may be serious imbalances, —re¬ 
sources may be quite incommensurate with the data awaiting tabulations; or one typo 
of resourco may bo in excess while others may bo in shortage. A permanent organisa¬ 
tion is in a hotter position to plan for and imploinont a balanced development in nocos- 
sary resources —both human and machine. It should be pointed out that it is rather 
difficult to secure mechanised tabulating equipment at short notico in this country 
and such difficulty is also duo to limitations of foreign exchange. An ad hoc survoy 
has, therefore, to meet great difficulty, particularly if tho tabulations aro to bo done 
by a temporary unit. Moreover, these costly equipmont oven if secured may not bo 
fully utilised throughout the period for which it has to bo retained by such a temporary 
unit. Incidentally, if a permanent organisation carries out investigations in ono 
particular subjoct-field continually then the various procedures would bo suitably 
standardised and the whole machinery will have a greater chance of running 
smoothly. 

74. A sampling plan which would be an excellent one only if it could bo 
carriod through, may be just tho opposite in actual practice if it is besot with serious 
practical difficulties about which the operation chiefs aro inoro familiar. Also, ono of 
tho serious impediments in the way of strict adoption o f probability sampling, 
even when there is tho ‘acceptance* of it by the executives, who aro gonerally not 
initiated in the theory of such sampling, is that such acceptance has not grown out of 
a real appreciation of the basic logic of tho inodorn theory. While implementing a cer¬ 
tain schome of probability sampling they may deviate considerably from tho rigorous 
procedure for convenience, believing that it ‘really does not matter’, or by trying to 
‘improve upon tho procedure* laid down. In a permanent organisation thorc is bottor 
scope for exchange of experiences and views between tho field and tochnical staff, 
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and therefore there is better chance of the removal, at least from future surveys, of 
any misconceptions which any one of the parties may have. 

75. The users naturally desire quick results. But early results also depond 
upon an early beginning of field-work. And early beginning depends upon early 
completion of preparatory work. That preliminary work may turn out to bo difficult 
and painstaking may not be sufficiently appreciated by one new to the field. The result 
is that the actual survey may be very much delayed; or what is perhaps worse, tho 
circumstances may turn out to be such that the statistical authority finds it ‘desirablo 
to begin the survey as scheduled, but on tho basis of very imperfect preliminary work. 
Such a method obviously would lead to comparatively poor rosults. Tho possibility 
of tolerating this state of affairs in a permanent multi-subject organisation is definitely 
less, because it is already in possession of some important background information and 
data, and might have taken propor and timely action in anticipation. 

76. There is tho question of building up tho necessaiy material resources. 
Fortunately, in many cases a collection of resources liko maps, directories, list of 
villages, summary data for territorial divisions otc., sorvos not only a single subjoct 
field but several. It must be mentioned that during the promotional stages it may not 
be possiblo to get such detailed and coraplot© knowledge unless tho scheme is drawn 
up by an authority who has had already some experience of conducting similar 
survoys earlier. This is another reason why a permanent sampling organisation is 
hotter fitted to prepare a more reliable sampling scheme. For large-scale oxtensivo 
survoys maps are indispensable, and a collection of maps is an invaluable asset—an 
organisation which has oarlier conducted oxtensivo survoys is. thoroforo. in tho happy 
position of boing already in possession of such maps, and whatovor survey may bo 
taken up in future such maps aro likely to bo valuable, and considorablo time will bo 
saved on preparatory work. 

77. Apart from tho use of maps and other data for purposes of stratification 
and allocation of sample, maps are necessary for zoning in regard to field work. For 
extensive survoys tho country is to bo divided up into a suitable number of fiold zones 
each under a field supervisor. These zones are to bo subdivided into investigation 
zones for investigators. Efficient zoning, which should givo special attention to 
questions of transport and communications requires some direct field experience, 
and that can only bo built up by a continuing sampling organisation, —because tho 
information contained in tho available maps, guides etc., although valuable, may not 
go far enough. Choice of convenient points, spread over tho entire country, for fiold 
offices requires oxporience and their establishment also takes time. 

78. In the efficient discharge of any work of a practical naturo like sample 
surveys, experience is of paramount importance. It might have been noticed in our 
earlier discussions, that a large number of our views as to which particular method 
is most suitable from the point of view of operational convenience or reduction of non¬ 
sampling errors has been based on experience. There are sevoral aspects of a survey 
for which no set rules, as to what the best procedure is under different conditions, have 
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so far been codified ; and as far as one can see, it may take a long time to make a 
systematic study of various experiences in different situations, before this can be done. 
One must, therefore, try to gather experience, and for this there is no better way than 
to establish a permanent survey organisation. The experience then would bo of 
immediate and permanent value to this organisation. Exchange of experience with 
sister organisations in India and elsewhere will naturally be of value also. 

Permanent organisation and promotion of sample surveys 

70. From the actual utilisation point of view it is just not enough to estab¬ 
lish the theoretical possibility of obtaining fairly precise results by sampling. To 
transform theory into practice, and that against the traditions of a census (comploto 
enumeration), is a stupendous job. It must be remembered that substantial oxpondi- 
ture is involved in a statistical survey, and it is not the survey statistician who decidos 
whether a survey is to be undertaken or not. To convince the deciding authorities 
movement in two directions becomes necessary : making the potential users appre¬ 
ciate the validity of modorn sampling method as a scientific tool which can be used 
with advantage ; and secondly, demonstrating the existence of a competent body of 
workers who can bo entrusted with the use of such a tool. 

HO. The promotion of sample surveys means some positive efforts on tho 
part of some competent jiersons. For effective results apart from the personality of 
the promoter of sample surveys an essential requirement is that ho should speak with 
conviction, — a conviction not arising merely from routine academic knowledge about 
t ho theory, but also from his own practical experience of the use of sampling technique, 
not necessarily in the subject-field in which the particular administrator might bo 
interested. Illustrations of successful use by foreigners of this technique liavo some 
desired effect on the administrators, but illustrations from the promoter's own ox- 
porionce of work conducted under domostic conditions reacts more favourably on thorn. 
It is obvious that only through continuing practical work it is possible to gather that 
body of experience which goes towards the making of a competent professional staff 
The existence of a permanent sampling body is. therefore, specially important for the 
promotion of sample surveys. 

81. One of the most important ways of promoting sample survey activities 
is to create demand by supply; a sampling organisation, only whon permanent, can 
be directly interested in creating such demand. To make the position somewhat 
more clear, the agency directly and act ively concerned with the spread of sample survey 
methods may deliberately try to collect not only the items of information which form 
the ‘real' substance of a particular statistical project but also a few selected key 
items on other (somewhat related) subject-fields. Once a potential user finds that 
the statistical organisation is already in possession of a few key items of Ins interest, 
he takes advantage of these results, and realizes at the same time that sample survey 
is capable of delivering important data. He, therefore, becomes more amenablo and 
inclined towards a full-fledged sample survey in the subject of his interest. It may 
be wondered why he has to wait for all these in order to initiate a sample survey. As 
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has been pointed out earlier, he is usuaUv 'comptete.numeration nund^.'^ *ndjy 

have very serious doubts about the utility of samp mg me hjmsolf 

enumeration may no. be feasible on financial and other grounds and he fee - urns 
helpless in the matter. But when he get, evidence that sampling is » P™ 

viding estimates which are plausible, his initial resistance ,s very much 
And then he also gets a demonstrat ion that there is an organisation capable of apply mg 
successfully the relevant techniques. 


82. It is. however, not quite a straightforward business Is. introduce 
a few •extraneous' items even though these may he obtained at an oxtiome y 
small marginal cost because the sponsor of the project may oppose -t e.tl.or 
because he has no liberal or progressive ideas, but more often under cnpphng rigidi¬ 
ties existing in official rules. Here the statistical authority has to use all Ins ingenuity 
if he feels that a straightforward approach is likely to fail. He may be in a happy 
position if he can spot a few items of direct interest in another subject-field, which 
also happens to be of importance in the current subject matter, in the sense • m 
these can throw indirectly some light on tho quality of the principal data, or may 
make such data more illuminating for purposes of analysis and interpretation. 


83, A bettor approach would he to establish a permanent sample survey 
organisation, however small it may he. to carry out surveys in various Helds. For 
such an organisation with permanent field staff, the problem would he what 
subjects to select, and not whether there is any party who is willing to corn© forward 
to make temporary use of the organisation to serve its own interest. There should 
not then he any serious objection if in any particular round a few key items on new 
topics are taken up for investigation in addition to any subject for which the round 
may he specially planned. 

84. There are wide gaps in statistical information in India and in many of 
the under-developed countries and there may not be any apprehension that subjects of 
importance at any time will ever be lacking. What may be lacking is the realization 
that sampling may be of help. And steady supply of statistical information, even if 
it is not specifically wanted by any authority to start- with, will itself gradually create 
demand for its continuation and elaboration. Possibilities opened up by tho samp¬ 
ling technique will become widely known among the potential users and demands 
may outstrip the capacity to supply and consequently expansion of the sampling 
organisation may he necessary. 


Permanent organisation and problem of sampling frames 

85. Suitable sampling frames (maps, lists etc.) may not always be readily 
obtainable. Experience about possible materials usable as frame, and information 
about thoir availability and suitability, and previous contacts with resource persons 
are needed. Even if some skeleton frame is secured there is no guarantee that it is 
up-to-date or is free from other defect-s. The extent and nature of the deficiencies in 
a frame can be better assessed by an organisation with some experience of samp- 


198 


D. B. LAHIRI 


ling work. In fact the very awareness and real appreciation, that defects in the 
frame as ordinarily found may have serious consequences, take time to grow. How 
best to emend a given frame is a question of experience. A permanent sampling 
organisation is thus better placed for sampling work. 

88. The errors arising from the use of faulty sampling frame are likely to 
be less, for a permanent sampling organisation as it can possibly finish scrutinising 
the frame for completeness, non-duplication, up-to-dateness etc., well ahead of the 
enquiry by anticipating and dovetailing this work with other statistical work specially 
during slack poriods. In an ad hoc enquiry such scrutiny is theoretically possible, 
but in actual practice it is likely that enough time may not be available for carrying 
out a thorough scrutiny particularly when the frame is brought into use for the first 
time by the enquiry authorities. Thus some errors arising from faulty frame seem 
inescapable. The time available between necessary sanction of the project, subse¬ 
quent staff recruitments, collection of frame etc., and actual survey date (a date 
which would be normally fixed by authorities other than the sampling statistician) 
may be much too small for careful scrutiny and correction of frame. 

87. A permanent sampling organisation may cut down costs of collection 
of a frame by utilising its already existing field offices throughout the country. It 
may bo noted that, once a sampling frame of areas (villages, urban blocks) is construc¬ 
ted, it may form the basis of (multi-stage) sampling in more than one subject. 

88. An alert multi-subject survey organisation of a continuing nature would 
always have an eye towards important subject-fields where there are gaps and carry 
out necessary exploratory and other preliminary studies on frame collection or cons¬ 
truction before a full-fledged enquiry is even thought of. This would enable an early 
beginning of the enquiry on a good frame. Frame construction or collection and 
emendation are of the nature of capital investment. Such investment may be consi¬ 
dered worthwhile only if it is to be used for more than one subject and for moro than 
one occasion. 

89. It will be noticed that a frame is required for carrying out a complete 
enumeration also. Indeed, the population census provides a great opportunity for 
building up a suitable sampling frame, particularly for large-scale surveys of a nation 
or state-wide character. It is, therefore, very important that in the drawing up of 
a census plan, an eye is kept- on the construction, with the minimum amount of work, 
of an efficient sampling frame for multi-purpose use in future. There must be. as 
is generally true in other cases, an effective promoter, and a permanent sampling 
organisation dealing in various subject-fields is no doubt the most appropriate 
promoter for this. 

90. Permanency, stability in location and identifiability of the units in such 
a census frame are necessary for futuro sampling use. The totality of all such units 
must cover even at a future daU* (if necessary, by small supplementary investiga¬ 
tion) all households, individuals, fields, manufacturing, transport and trading 
‘establishments’, and so on, as the case may be. In India, at the present stage of 
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development, it has not been found necessary to maintain for administrative or other 
reasons a current list of millions of household manufacturing, trading ami other 
establishments. If a list is prepared along with the population census, then it may 
be concurrently used for detailed sampling enquiry, (assuming that the census listing 
is fairly reliable), but it quickly becomes out of date with passage of time. 

01. The requirements will mostly be met if the entire country is broken 
up into a large number of well-demarcated parcels or blocks of land, and each such 
parcel is assigned to a separate group of one or two census enumerators. Care should, 
therefore, be taken by the |>crmanent sampling organisation to ensure that a record 
is kept of the census frame, giving particulars of oach such parcel for future use as 
a frame for sampling. But in order to be of use on a future date the boundary 
specifications must be in terms of entities which are identifiable in future. In 
carrying out a survey at a future date on any subject-field, say. on household 
manufacturing establishments it would be necessary for the investigator to construct 
the current list of establishments, for sub-sampling, only for the sample parcels during 
his visit there. It may be necessary for the survey organisation to modify the urban 
frame of blocks to allow for the changes in the boundaries of cities and towns. If the 
census authorities do not form areal units then tho sampling organisation itself may 
have to construct one for its own use, unless such units are otherwise available ; in 
rural India ‘revenue villages’ or mauzas are such units. The expenditure on such 
construction may be worthwhile only if several enquiries are carried out year after 
year. Such frames may be used by the census authorities also, as happened in India 
in the 1001 census when the NSS blocks in some of the cities were utilised by the 
census authorities. This adoption by the census is of help to the NS.S also because 
estimates of ‘sizes' of the NSS blocks would, therefore, be obtainable from the census. 

92. Tho units in tho frame should bo sufficiently small so that, within any 
reasonable budget a largo number of them can bo listed whenever nocossary. Thus 
sufficient resources for the enquiry proper would be loft for a well-scattorod largo samplo. 
It is therefore important to ensure that a record of tho ‘size* of oach unit obtained in 
tho census is preserved for future use. This information, if properly used at tho 
timo of samplo selection or at tho stage of estimation, may cut down costs of a 
sampling onquiry which may be taken up later. There aro a numbor of points 
which need consideration in this connexion. 

93. First, the choice as to what ‘size’ or ‘sizes’ arc most suitable requires 
special attention and study; and a technically equipped permanent sampling organisa¬ 
tion, seized with the responsibility of covering various subjects (actual or potential) 
is competent to suggest and press for them. Such ‘sizes’ should preferably be of 
interest for their own sake even at the (enumerator’s) block or village level, other¬ 
wise, the census authorities may not be quite willing to go through the trouble of 
such detailed tabulations, even though they may bo prepared to tabulate the same 
item or ‘size’ at a higher, say, regional level, each region being constituted of several 
blocks or villages which may be adopted as the units of sampling. 


200 


D. B. LAHIRI 


94. The question of choice of any set of sizes for purposes of possible 
future sampling work, of course, will have to be solved before the census plans are 
finalised. One must take stock of what subjects of enquiry are likely to be taken up 
in the future, and select the sizes accordingly. Two sizes appear to attract 
special attention : these are 'population' and “cultivated (or geographical) area’. 
Small-scale household and cottage industries, for example, are likely to be of parti¬ 
cular interest in India. If. as in India, there are points of concentration (even adja¬ 
cent villages have widely different concentrations of such industrial establishments), 
it may be important to keep a record of such concentrations (possibly by type of 
industry). The awareness that there are such isolated points of concentrations, and 
an appreciation of the seriousness of the above technical requirement from the point 
of view of sampling efficiency can grow with comparative case in a multi-subject 
permanent sampling organisation. 

95. In a practical situation, at least, as obtaining in this country, 
the sampling statistician may more often than not find himself called upon to select 
his sample villages/blocks, according to some efficient design to be evolved by him, with¬ 
in a time limit which is much too short. If he belongs to a permanent organisation 
he can devise methods of obviating this difficulty to some extent. Considerable 
time in selection may be saved if a master-sample is kept ready. A record of a ran¬ 
dom sample of villages (selected with replacement) with order of selection may bo 
maintained for each medium-sized territorial division separately. This will meet all 
systems of stratification and sample allocation, provided strata are formed by group¬ 
ing together such territorial units. Considerable ingenuity may have to bo exorcised 
if such a master-sample is to provide simultaneously for different probabilities of 
selection and suit varied subject-fields. 


Permanent organisation and assessment and 

CONTROL OF NON-SAMPLING ERRORS 


96. In a sense, the first requirement in the control of non-sampling errors 
is to become conscious that such errors do occur, and occur in spite of all the care 
that would generally be accepted as sufficient in other situations. One must be aware 
that such errors may neither be of infrequent occurrence nor need they be of negli¬ 
gible magnitude. This awareness takes time to grow. Continued experience in 
the field of statistical surveys gives one scope for realisation that in large-scale sur¬ 
veys, in spite of all routine steps for careful work, non-sampling errors are sometimes 
quite serious. With increasing awareness of these errors, there is an urge for the 
development of suitable techniques for detecting and controlling various types of 
errors. It is important to point out in this connection that the Professor always 
speaks in terms of controlling errors rather than their total elimination. This is in 
conformity with the basic logic of rational use of resources. 


survey 

errors. 


07. Some general considerations would show that a permanent or continuing 
organisation is best suited for assessment and control of non-sampling 
This subject offers a virgin lield for serious investigation and at present 
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our knowledge in this field is rather poor. A close study of the details of discussions 
in the planning of statistical surveys would show how the plan is affected by consi¬ 
derations based on meagre objective evidence, or subjective assessment, no doubt 
supported by what is termed experience. 

98. There is a wide gap between theory and practice of sample surveys. 
And what seems unavoidable now may not remain so for ever, because with the objec¬ 
tive of narrowing the gap always in the fore front; special attention will be given 
by a permanent survey organisation to these ‘unavoidables* and techniques for 
achieving the above objective will be developed. 

99. It is true that now, even two decades after the Professor s critical and 
elaborate studies, the subject of non-sampling errors has not been explored so fully 
as to enable one to strike at the solution straightway. But in making some progress 
one should try to have some idea at least of the various sources of error, their relative 
order of importance, and their nature. Sample surveys, particularly large scale ones, 
present serious problems of control, but one cannot think of very high order con¬ 
trol at the vory initial surveys. By keeping an ever careful watch on the situation 
in the earlier surveys and by developing suitable techniques to cope with it. necessary 
controls can be established in later surveys. Incident-ally if the same subject 
is taken up continuously round after round then inter-round comparisons throw 
a good deal of light on the validity of the results. For example, in a continuous 
consumer expenditure enquiry one may study whether the quantity consumed or 
expenditure incurred on various items for various income or expenditure groups is 
changing in the manner in which one would expect thorn to change with chnngo in 
prices. 


Intkrpenktratino network of samples 

100. It has been pointed out previously how errors of various types enter 
into the production of statistical information, whether on the census or sample basis. 
On general grounds, there is reason to believe that sample (SS) data are amenable to 
better control than the census (CE) data in respect of non-sampling errors. But, 
in addition to betterment of general administrative and supervisory control a means 
for better technical control must be provided. There should also be some means of 
assessing the magnitude of errors —sampling error, response varianco, and so on. 

101. For the abovo purpose the technique of interpenetrating network 
of sub-samples (IPNS). coupled with the method of analysis of variance, intro¬ 
duced by the Professor in India more than twenty-five yoars ago is very useful. This 
technique in its general form consists of drawing a sample in the form of a number 
of parallel sub-samples, each capable of providing a valid estimate of a population 
characteristic. Usually the sub-samples are subjected to different treatments or opera¬ 
tions in a proscribed manner. For example, different sub-samples may be assigned 
for investigation to different agencies or to different batches of investigators. Or 
the editing, coding and tabulating work of some of the sub-samples may be assigned 
to one batch of workers, and the other sub-samples to another batch ; or, even if the 
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same batch works on both sets of sub-samples, the two sets of sub-samples may bo 
differentiated by somewhat different operational conditions, which are likely to occur 
if their processing is taken up at different points of time. 

102. The power of this technique hinges on the means which it provides of 
comparing a number of estimates, obtained ‘independently’, of the same characteris¬ 
tic. * Agreement' among the estimates indicates that the process is under control ; 
if there is no agreement, there is possibly some disturbing source, and a search may 
help locating it. Experience shows that this method, if properly used, leads, in a 
large proportion of cases, to major sources of disturbance. Corrective measures or 
suitable adjustments can then be adopted. For example, for processing checks the 
sample may be divided into, say, four IPNS sub-samples, and estimates may bo 
obtained from each of them. If there is agreement between these estimates, it can 
bo assumed that the operations, broadly speaking, have been done correctly. If one 
of these differs considerably from others and there is agreement among the rest of 
estimates, the calculation on that sub-sample is suspected and appropriate 
processing stages arc checked. Experience shows that, even with only two sub- 
samples, an ‘unreasonable’ divergence between the estimates may point to, and, 
on search, may help to locate some controllable source of error. It is important 
to emphasise that the purpose is control, not elimination of errors, and no efforts 
need be made unnecessarily on minor corrections if the IPNS estimates are within 
permissible limits. 


103. Special attention may be drawn to one of the most important aspects 
of the sampling system which the Professor has been able to set up. This is in essence 
an IPNS system with the participation of Central government staff for some sub¬ 
samples and of State government staff for other sub-samples. The participation of 
the two kinds of agencies is not only in respect of field work but also in regard to 
tabulation. Comparison of differences between and within agencies helps to control 
errors at various stages. Moreover by pooling the results, when there is agreement, 
more precise estimates are obtained. 


104. By the above means it has been possible to co-ordinate really different 
surveys on the same subject by different agencies. Use of different definitions 
and procedures for the same entity by different agencies is not an uncommon experi¬ 
ence. This causes loss of comparability and sometimes misinterpretation of data. 
This is sought to be avoided by bringing in the States in the NSS system. I 1,8 * cs " JJ 
not only in adoption of common definitions and procedures in the enquiries com]^ted 
under the auspices of the NSS. but also in increased chance of adoption of the s 
definitions in other enquiries conducted independently by various State authontree. 
it is thus seen that the preferred survey system indirectly helps in standardising 


concepts, definitions and procedures. 
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of oitlior. This is a very important attribute of the system, because a singlo 
non-IPNS estimate, would not carry as much conviction to such a user, even when 
the standard error of the estimate is given. Incidentally, IPNS estimates provide 
directly a means of sotting confidence limits to an estimate; and, further, estimates 
for different strata or strata groups provide a simple method of obtaining estimates 
of the standard error (including response variation). Refinements may be made to 
study sampling and response variance. 

106. Another point indirectly connected with the IPNS system may be 
mentioned. It is not sufficient to plan merely for a probability sample. One has 
to ensure that the entire plan is carried through. Sporadic omissions of sample 
units due to investigator turnover can make an originally intended probability 
sample very much different. One way of guarding against such an eventuality is 
to break up the sample in each stratum into two or more valid sub-samples and ensure 
that at least one such sub-sample is covered completely. This fits in with the idea 
of interpenetrating sub-samples where different sub-samples arc assigned to different 
investigators, or different batches of investigators. The incomplete sub-samples 
may be compared with the complete ones to find out whether their inclusion would 
mean introduction of non-negligible biases. 

107. The IPNS system may even be less costly in spitoof the‘additional cost’, 
for oxamplo, on journey, since the teams of investigators have to cover separately 
and independently the area under investigation, if the sub-samples aro differentiated 
by differont investigating parties. Tho term ‘additional cost,’ soraotimos usod by 
critics of IPNS, is really misleading ; there would be no point in incurring this expendi¬ 
ture if it wero already known that the operations aro undor control, that thore is 
no scopo for difforontial operator-biases, and no nood of assessing the margin of un¬ 
certainty. But oxperionce in the Indian Statistical Institute shows that this is not so, 
and such oxponditure (of a marginal nature) on the IPNS system, which meets all 
these needs, is not just for nothing. That other methods having theso advantages 
exist and arc less costly, for a multi-subject survey with thousands of estimates, is 
yet to be established. 


Survey plan and communication difficulties 

108. In extensive surveys the survey plan has to take the transport and 
communication problems into special consideration. In Indio the transport and 
communication system is more or less under-dcveloped. If. therefore, it is desired 
to have a survey in which a supervisor or crew leader is expected to have almost daily 
contact with the investigators or enumerators under his control, the jurisdiction of 
the super,-,sor can only be extremely small, say. an area with a radius of five or six 
miles. In countries where the communication system is developed tho jurisdiction of 
a supervisor may be much larger. 
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such areas, and consequently larger would be the requirements of supervisors and 
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investigators. This in turn would generally mean, in a country with scarcity of quali¬ 
fied and experienced people, a lowering of the average level of the field staff and conse¬ 
quent increase in ascertainment and other errors. Operational errors arising out 
of increase in managerial problems would also go up in the field. The field costs 
would go up because of increased field strength. 

110. Again the smaller the supervision-areas the larger is the number of 
such areas (for a prescribed precision), which again would lead to increase 
in the volume of survey data and consequent operational errors in processing also. 
This again implies lowering of average level of processing staff and consequent 
increase in processing errors and increase in processing time, not only due to increase 
in the volume of data to be processed but also due to poorer performance ; there would 
also be considerable increase in processing costs. 

111. It is thus seen that the very attempt to control ascertainment errors by 
closer supervision may tend to increase errors from other sourcos. For small-sizod 
supervision-aroas the cost for a given precision might be higher compared to a scheme 
with large supervision areas. This is so in spite of the fact that larger supervision 
areas would mean greater journey costs per investigator. What the net effect would 
be under the above two situations, if one were to consider both sampling and non¬ 
sampling errors, is not very important to discuss from a practical unglc. NSS 
experience shows that for any reasonable precision (sampling orror), the cost would 
be absurdly high and several times higher than what it would be for some scheme 
with large supervision areas. But, to be useful, such a scheme should not involve 
large ascertainment errors. That this is not impossible to achieve will be explained 
presently Before wo do that wo may point out that the increase in the sample 
size would not have been so large in a similar but small-sized country. For such 
a countrv, for a given number of supervision areas, such areas would be more closely 
packed - and, also, the total supervision areas would account for a sizeable proportion 
of the country. Thus one may expect that ‘between supervision area’ contribution 
to the sampling variance would not be so largo. 


112 Now we come to the feasibility of having larger supervision areas. 
If it is possible to recruit specially qualified superior level investigators, and. if they 
are specially trained and experienced in survey work, .t may not be necessary to hace 
a plan in which the supervisor needs to have constant touch with the Invest.ga^r. 
an l the size of a supervisor's jurisdiction may then be vastly increased. It would 
thus appear that the level of the investigator must be higher than that of the 
enumerators usually engaged even in an economically advanced country. 

113 There are other good reasons, which we have already explained, why 

r should be specially skilled. We may further add that he may him- 
the investigator - ho I snecifications a sample of households, enterprises, 

rr the sampie vmage - The commu,,ication 
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system may be so bad that despatch to a central placo and receipt of the sample list 
therefrom may mean considerable cost, delay and uncertainty. 

114. It may be pointed out incidentally that these skilled and educated 
investigators may mostly disfavour small supervision zones. Smaller zones are less 
likely to contain any good urban area, and an educated investigator and his family 
would very muoh dislike to stay wholly in backward rural areas without adequate 
housing arrangements, social amenities and educational facilities. 

115. One peculiar feature of the transport system in an under-developed 
country, which has a bearing on travel time and costs, should not be lost sight of. The 
entire country is not uniformly under-developed. The transport system may be 
advanced (e.g. where the points between which a journey is to bo mado arc connected 
by railways) and the time (and expenditure) may be low, even if the points are com¬ 
paratively far apart. On the other hand, even if the two points arc fairly dose (as 
the crow flies), there may not be any transport system, so to speak. Travelling may 
therefore be very arduous and timo consuming, and this will be more so when an in¬ 
vestigator has to take a circuitous route because of difficult terrain. It would bo 
quite wrong to suppose that travel time (and costs) varies directly with the distance 
if the distance ranges from very small stretches, where primitive methods are to 
be adopted, to comparatively large ones where railways and buses may be availed 
of. Thus a change over from very small investigation zone to a fairly large ono may 
not mean as much difference in time and effort ns it appears to be ; and it may be 
quito feasible to increase the supervisor's jurisdiction substantially by having 
investigators somewhat loosely connected with him, provided ono employs 
investigators of better calibre who can carry on the investigation without close 
guidance. 


Stacoered survey 

110. The desirability of having a permanent survey organisation with per¬ 
manent staff was emphasized earlier. It is, howovor, necossary to formulate the 
objectives of an enquiry to fit in with such a permanent sot-up. What is to be 
done when, for example, for items subject to recall lapse, ono wants fairly reliable 
estimates with reference to a particular point of time, or to a very short period, sav. 
a particular week ? In such a case a largo sample will have to be covered in a short 
time immediately after the point or period of reference; and an army of investigators 
will be required for this purpose, and very few countries can think of maintaining 
such an army on a permanent basis. In any case, as explained elsewhere, the 
incidence of non-sampling errors would be very largo. So here is a case of apparent 
failure of a practicable scheme of whole-time permanent field staff. But will not an 
average picture over a longer period, say, a year, be good enough, if not better? This is 
a very crucial point,-once it is seen that the modification is acceptable there is no 
reason why a small band of permanent whole-time investigators will not bo able to deli- 
ver the goods. All that they need do is to spread the enquiry over a sufficiently long 
period. The above modification of the objectives is thus of paramount importance. 
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Hi- India has an agricultural rural economy depending mostly on natural 
c imatic) conditions, and, as such, a large number of economic and social characteris¬ 
tics are subject to pronounced seasonal fluctuations. To allow for the seasonal fluc¬ 
tuations one may collect data for a reference period of one year from each 
unit o enquiry. But, except for the organised sector which is comparatively small, 
no accounts are kept, and one has to depend mostly on memory. Lapses in memory 
may be quite serious for a long reference period like one year. One should, therefore, 
devise a suitable scheme with a shorter reference period like day, week or month. 

I his is achieved by spreading the sample evenly over all the seasons or months or 
weeks of the year, and it will be possible then to estimate the average conditions for 
the entire year, oven though sufficiently precise estimates for different periods or 
seasons of the year may not be obtainable because of possible smallness of the corres¬ 
ponding samples. In a vast country like India the sample points must be com¬ 
paratively more scattered and differences over space may be quite important. 
To obtain more precise annual estimates, instead of sticking to the same sot of 
localities (villages) throughout the year, it is more effective to change the sample 
points (localities) from one period to another so as to achieve bettor representation 
ovor space, in addition to representation over time. This is true in spite of some 
reduction in the sample size to meet additional costs on journey etc. This is more so 
for those items (on which data are also usually collected), which aro not quite 
so seasonal. It may be incidentally pointed out that an investigators stay in the 
same village throughout tho yoar inay not be otherwise dosirablc or, even, possible. 

118. It is of importance to point out that recall lapse is not minimised 
merely by adoption of a short ‘fixed* reference period ; that is, a short period whoso 
end points are fixed dates. Because, the memory lapso depends upon tho interval 
between the reference period and the date of enquiry, (shortly, tho recall period), 
which may be quite long. We have therefore to use a short' moving* reference period 
immediately preceding the date of enquiry. Obviously, it would bo excellent if 
one could have fairly precise information separately for each of tho 'fixed* short 
time periods into which a year may be partitioned, like calendar weeks or months. 
But this is hardly possible with limited resources, and one has to be satisfied with 
a picture averaged over the year. 

119. The effect of varying reference and recall periods may be studied by 
suitably tabulating the records of reported dates or months of occurronco of the ovonts 
during a sufficiently long specified period immediately preceding tho survey date. 
But the differences duo to memory lapse get confounded with actual differences. In 
a staggered survey, with overlapping reference periods and somo common units bet¬ 
ween different rounds or sub-rounds (planned survey periods in continuing surveys), 
a direct assessment of tho effect of memory lapso is possible. 

120. The question of staggering arises in other connections. Firstly, the 
annual sample size, adequate for providing, say. State estimates, may be inadequate 
for smaller regions. However, by pooling the results over two or more years suffi¬ 
ciently precise estimates at the regional level may be obtained. More generally, 



MULTI-SUBJECT SAMPLE SURVEY SYSTEM 207 

continuing an enquiry over several years is a simple compromise to meet the ncse*l 
of different sample sizes for different items of information, for different regional break¬ 
downs, and for different purposes. Again, sufficiently precise estimates for study of 
seasonal variations may be obtained by pooling the data over several years for the 
same season. Continuing survey is also an insurance against the planned sample size, 
for a round, proving inadequate due to uncertain knowledge about the variances. 
Covering the survey by sub-rounds may enable production of some estimates (all- 
Indio, on some key items), even before the completion of the entire round. Also, when 
the survey is staggered over a long period by sub-rounds, then timely steps at the 
first sub-round will improve matters at subsequent sub-rounds. 

121. If surveys on tho samo subject are conducted, say. at the end of fivo or 
ten years, the change observed may be difficult to interpret, because a year may bo 
a‘freak’ year. Such years are not of infrequent occurrence in countries whoso economy 
doponds heavily on tho vagaries of naturo. Thore will bo additional difficulty 
if tho surveys relate not to whole years but. say, to a particular month, bocauso, 
tho harvesting to which the entire rural activity is so closely linked up may not occur 
exactly at the same point of time every year. Under these circumstances a better 
course appears to bo to study the ‘trend' of the annual estimates obtained from a 
scheme of continuous onquiry. Difficulties would still remain if tho subject continuity 
is in respect of only a particular section of the population, and intorsectional transfers 
(like agricultural wago carnors turning to cultivators and vice versa) aro substantial, 
unloss all tho sections aro simultaneously covorcd. 

Sampling for special groups and multi-subjf.ct f.nquirif.s 

122. In the unorganised sector, which accounts for tho largest share of econo¬ 
mic activities in under-developed countries, the identification of a person as belonging 
to a specified activity group may not be very simple. Tho basic difficulty arises from 
the fact that the population has no clear-cut and natural classification into economic 
groups so as to be easily understood by the general mass ; and tho number of marginal 
or doubtful cases may be considerable. For example, in the rural areas, it may not 
be an cosy task to label persons in the labour force into two categories—agricultural 
and non-agricultural. Tho difficulty in the first instance lies in the novelty of the 
concopt of labour force under Indian, particularly rural, conditions. Moreover the 
same person may often bo engaged in both agricultural and non-agricultural activi¬ 
ties on the some day or week and this is the second difficulty. The ascertainment 
of correct information involves very special care. 

123. These considerations complicate phase sampling. For example, in 
a survey of the economic conditions of agricultural labourers who earn their liveli¬ 
hood mostly by working in another's farm, first a sample of villages may be selected 
and then a sample of households with one or more agricultural labourers (shortly 
agricultural labour households) in each selected village. The normal procedure would 
bo to label each household as agricultural labour or not, at tho time of listing tho 
households in tlio village. The separation of agricultural labour households because 
of the existence of large numbers with mixed activities, (and for other reasons), may 
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not he so simple and straightforward as to be quickly settled at the listing stage ; 
several auxiliary questions are to be asked before correct identification is possible. 
First phase (listing) work will, therefore, have to be done carefully and in details and 
sufficient time for this purpose will have to be set apart. Any error introduced in 
classifying the households will naturally affect the ultimate results. Experienced 
whole-time statistical staff would be most suitable for competent work of this type. 

124. Again, in a sample census of agriculture restricted to holdings above 
a certain specified size, as is sometimes done, there are similar difficulties. First, a 
holding is to be spotted and a good deal of probing is necessary to examine whether 
it is agricultural or not. and then finally to ascertain whether it falls above or below 
the specified size. The problem of identification of a holding is perhaps more acute 
in India than in the West because it is not an easily identifiable physical unit, as a 
largo factory is. 

12.1. One has of necessity to enter a holding, if any, through a household 
which is an easily recognizable unit. Which portions of the total possessions of a 
given household constitute an agricultural holding may not again bo easy to deter¬ 
mine. Again, if the area (acreage) of the holding is not properly determined, either 
because of wrong ascertainment of its constituent fields, (which may not form a com¬ 
pact area), or of their acreages, (which may not be correctly known to the infor¬ 
mant), it may be wrongly included in or excluded from tho scope of the enquiry. 
The consequence would not have been so serious, as oxplainod below, if the number 
of holdings of size in the neighbourhood of the usually recommended dividing line 
were not so large in a country like India. 


126. In order to reduce the load of work the usual practice in agricultural 
censuses in most countries, as stated above, is to omit holdings below a specified size. 
It is supposed that such omission docs not cause any great loss because the ‘contribu¬ 
tion’ of the sector omitted is not great. The 'contribution* hero has reference to items 
of tho type, total area under a crop. But the contribution to tho number of agricul¬ 
tural holdings may depend very much on where exactly the line is drawn, because 
in a country like India the number of holdings in the neighbourhood of any ‘reason¬ 
able’ line may not be negligible. The result is that the average size of a holding, 
for example, may bo very much affected by where the lino is drawn, and any bias in¬ 
troduced by wrong exclusion or inclusion of holdings in tho survey may also affect 
this and other averages appreciably. Careful and detailed work would be necessary. 
Thus one has again to spond sufficient time at tho listing stage. 


127. It may be helpful to introduce, along with the survey, say, on consu¬ 
mer expenditure or'employment of a special group (agricultural labour households) a 
similar survey of the residual groups. If full particulars required for correct classifica¬ 
tion is made an integral part of the common scheme of enquiry then special attention 
need not be paid at the listing stage merely for the identification of the single special 
group,and a substantial portion of the investigator's time on listing can be diverted to 
detailed enquiry about all the groups. The classification of the -ouseho ds migl. b 
done at the tabulation stage, and this would generally mean less of d^.fica'.on 
errors compared to that in categorisation at listing stage. Tins mult,-sector scheme can 
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be thought of in a multi-subject organisation. It should also be emphasised that for 
a proper appreciation of the characteristics of any special group it is very desirable 
to secure comparable estimates of the residual groups. In an enquiry of the agricul¬ 
tural census type, canvassing exactly the same schedule for the residual (non-agri¬ 
cultural) group may not be meaningful. But if the survey is multi-subject, and the 
general population is covered for some other subject, then some key information on 
agricultural and other holdings may l»e collected along with such an enquiry which 
will reveal the existence, if any, of serious classification errors at the listing stage. 


Costs and integrated desion 

128. We have in the beginning stated that the multi-subject nature of the 
NSS organisation is one of its major characteristics. It is now important to consider 
why, from the technical angle of sample design, so much importance should bo 
attached to this in an economically backward country like India. 

129. From the point of view of sampling efficiency in relation to costs, thorc 
is a strong caso for multi-subject surveys. The integration of different enquiries on 
the ground of economy is of tho greatest importance to an economically underdeve¬ 
loped country like India. Economies can be effected in respect of planning, super¬ 
visory and administrative services. Economics on other important common factors 
are pointed out below. 


130. Substantial expenditure must bo incurred on journeys betwoen ami 
within villages in a country with poor transport and communication facilities ; 
and it will be remembered that distances between sample villages cannot bo small for 
a vast country like India. Setting up a camp in the village is not quite simple, 
and establishing good relations with tho village community, which is of great impor¬ 
tance in regard to successful completion of enquiries, whatever the subjects of 
enquiry be, takes time. Contacting samplo households and their heads or other 
appropriate porsons, and establishing rapport also takes time. Suitable sampling 
frames may not exist, and tho investigator himself has to construct ono, a list of 
households, if it is a household enquiry. This is a time-consuming job ns there are 
about a hundred households in nn average villogc. How considerable this expenditure 
may be can be roughly judged from the fact that in tho NSS only about a third of 
the investigator's time is spent on enquiry proper. This is so in spite of tho fact 
that he has to cover several subjects in a single visit to the sample village. 

131. It may not be possible to secure economics on all the above factors. 
It depends upon tho type of integration among different subject-fields. At one 
extreme one may have advantage only in respect of administrative matters. This 
may happen when the same organisation has to conduct two entirely different en¬ 
quiries like those on ( 1 ) large-scale factories, and (2) rural retail prices. At tho 

d ^ for tw“° ^ , th0 T Whe " th ° 501,16 Samp,C Units (households) supply 
monn H ° r m ° rC 8U ^ Je ? t8(f0r examp,c * births - deaths - migration and empby 
horo w U r° WC ^ advantages, and there may be further savings because 

there will be in general some items of common interest to all the enquiries which need 



210 


T>. B. LAHIRI 


not be canvassed separately for an integrated enquiry, (for example, list of members 
of household with demographic particulars). 

132. There will be cases of intermediate degrees of integration giving limited 
advantages. Savings on village selection, supervision, journey, listing etc., will 
accrue when in the same sample village (1) different households or (2) different types 
of sample units are taken up for different subjects, like households for consumer 
expenditure or employment, and fields for land utilisation. Even when different 
villages are selected for different enquiries there will be savings in journey time, if 
the different sets of villages falling in the same ‘investigation-zone’ are canvassed 
by the same investigator. 

133. Integration of a subject with other subjocts is specially important 
when the units, for example, household trading or manufacturing establishments, 
are highly concentrated in a small proportion of villages scattered throughout the 
country. Othor villages may be individually unimportant but their shoor numbois 
make the totality quite important. But to cover this hugo sector a substantial 
number of samplo villages are to be taken, and this means vory largo travelling 
and listing costs if only one subject of the above typo is to bo covorod. For a multi¬ 
subject plan, however, the allocated costs for this subject would bo substantially 
lower, specially when the villages in this sector aro individually important for othor 
subjects. 

134. Thoro aro other reasons why there would bo savings by integration; 
those aro not quite so obvious. To give some concreteness to the situation lot us sup¬ 
pose that it is desired to carry out general household enquiries in the following sub¬ 
jects, (1) consumer expenditure, (2) employment, and (3) births and deaths. Let us 
suppose that for separate enquiries, according to appropriate sampling designs one 
requires /„ I 2 and / 3 investigators respectively. Now if all tho resources are pooled 
together then one can certainly engage (/,-f-/ 3 ) investigators and save vory 
substantial amounts on top administrative and other general overhead expenditures 
such as those on fiold offices. Moreover, the investigation-zone of each invostigator 
becomes smaller due to increase in the total number of investigators; and hence 
tho journey time between villages decreases, thereby allowing some savings in 
investigator-time and. therefore, one can afford to work with a smaller numbor of 
investigators and yet cover the same set of sample units. 

135. Again, instead of drawing the three sets of samples independently it 
is possiblo to draw them, at least in principle, so as to maximize tho numbor of 
villages common to two or more enquiries. Then there will bo further savings duo to 
decrease in journoy time, both between villages and within villages, and in costs 
like camp-setting, listing of households etc. Whatever we have stated above is 
irrespective of the probability of village selection which may differ from enquiry to 
enquiry; it holds even when the system of stratification is different for different 

enquiries. 

136. In the above scheme there would ordinarily bo large number of samplo 
villages where all the heavy expenditure on journeying, camp-sctting, listing, etc. 
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would be made yet certain enquiries would bo omitted ; this is obviously undesirable. 
It would appear that a self-weighting sample, spreading a given number of 
sample units over larger number of villages, would, for usual populations, increase the 
precision considerably. Thus there is still scope for substantial savings without 
decreasing the precision originally contemplated, if all the sample villages arc taken 
up for all the enquiries on smaller, but adoquate, second-stage samples. Further 
reduction with altered number of sample villages is possiblo. Incidentally, utilisation 
of a larger number of investigators for an enquiry, itself, increases the precision of 
the estimates, (even when the samplo remains identical). 

137. We have indicated how precision is increased by adopting eortain 
steps, and since precision greater than the prescribed one is not needed some savings 
may bo made by reduction in sample size. In this connection the most crucial role 
is played by the very large increase in the number of first-stage units (villages) made 
possible by the integration of several enquiries. Reduction will bo found to bo 
substantial in terms of number of samplo households, (or other units), which can bo 
further decreased by the doubly beneficial reduction of within-villago variance by 
having stratification of households on the basis of somo simple information collected 
at marginal cost at listing stage. The savings will therefor© be considerable parti¬ 
cularly because the cost of data collection and tabulation per household is heavy 
compared to other costs in a multi-subject socio-economic onquiry. 

138 In actual practice a common system of stratification of villages may 
be preferred. It may appear to be a 'compromise' stratification and as such n0C08- 
sarily inferior to the 'optimum for any ono particular onquiry. This would have 
boon true if the comparison woro on the basis of fixed samplo wzo, but hero it 
should be on oqual expenditure basis. Bocauso of integrated nature a considerably 
larger number of samplo villages would bo covered than what would bo possible for 
an independent enquiry with tho samo allocated expenditure. Gains duo to strati¬ 
fication deponds among others on tho number of strata, and tho possibility of having 
a larger number of strata dopends upon the largeness of number of samplo villages. 
With numorous strata, however, multiple stratifying characteristics arc to be usod 
for larger gains. 

139. Normally, territories like Ichsils, counties or communes nr© combined 
to form strata. If tho subject-multiplicity is high and the survey is staggerod over 
a long period, then the number of sample villages may bo large enough to allow treat- 
met of each territory as a separate stratum; and the intricate problem of optimum 
combination for strata would not arise. Even when it does, usually the available strati¬ 
fying characteristics of the territories are so few and of so general a nature, that what¬ 
ever bo the subject matter, there is really not much choice between ono reasonable 
system of stratification and another. Other situations are dealt with below. 

140. If data are available on a stratifying characteristic which is closely 
related to one or more of the subjects of enquiry but not to others, at least so closely, 
then the solution of the stratification problem rests upon tho empirical facts-! 1 ) 
w,th a single stratifying characteristic only a feu, strata, (obtained, for example by 
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arranging and then grouping the units by the value of the characteristic, if quanti¬ 
tative), extract nearly as much gain as a much larger number of such strata, and ( 2 ) 
because of the largeness, in a multi-subject system, of the number of sample villages 
and therefore of possible number of strata, there is still considerable scopo for a se¬ 
quence of (sub-stratification of the few strata formed as in ( 1 ) above, by moans of the 
other stratifying characteristics. Such sub-stratification by other characters (if 
not uncorrelated with the character to be estimated) is likoly to bo more fruitful. This 
method (sub-stratification) would not bo adequate in the rather unusual situation 
where tho number of stratifying characteristics, each closoly relatod to one (or more) 
of tho subjects of enquiry but uncorrolatod with tho others, happen to bo very largo 
in relation to the maximum possible number of stages of sub-stratification because 
of limitations of the sample size. In such a case tho mothod of multiple stratification 
with some control of sub-strata is to be explored. In any case tho scopo for strati¬ 
fication in a multi-subject survey is much more than that for any of the component 
subjects covered independently with the same (allocated) expenditure. 

141. Tho problem of allocation of the first-stage sample (villages) to different 
strata in a multi-subject two-stage sample survey may appear to be difficult. But 
this is really not so for a self-weighting sample design (or one nearly so). With pres¬ 
cribed si/.os for the second-stago samples for different subjects oven modoratoly largo 
deviations from optimum allocation of first stago units for any one subject would not 
gonorally mean any substantial loss of precision. Frequently precise data for optimum 
allocation for a subject are not available, and ono has to bo satisfied with the alloca¬ 
tion derived from somo ‘reasonable’ ostimatc or idoa about such data, with tho expecta¬ 
tion, based on tho above principle, that the allocation would bo near optimum. A 
suitable ‘compromise' allocation obtained by joint consideration of tho most desirable 
independent subject-specific allocations on the basis of the available knowledge may 
not bo very widely divergent from any of the subject-spocific allocations. In practice 
tho compromise allocation may be obtained by taking a simple or woighted average of 
the independent allocations, or by other means. It might bo instructive to oxamino, 
particularly when tho divergence is large, whother for any specific subject the ‘com¬ 
promise' allocation in any stratum is loss than what it would have been for an inde¬ 
pendent enquiry not with the same sample size but with the samo allocated’ expendi¬ 
ture. This would mean a much smaller sample. Stricter comparison would bo with 
a still smaller sample as would bo consistent with tho marginal' savings that might 
accrue by dropping the enquiry on the particular subject, of course without affecting 
the precision of other subjects. The ‘compromise’ allocation would rarely bo smaller 
for any stratum. Even in such rare cases where this is true it might be possible to 
adjust the allocations in such a manner as to secure a larger sample for every stratum 
for every subject. In this way a revised compromise allocation may be obtained 
which gives definitely better sample than that for independent enquiries. But this 
revision may not be important. 

142. As regards a single system of probability for selection of villages with 
sub sampling of households so as to achieve a self-weighting design, it appears that 
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ordinarily there would be no material difference, whatever bo the probability of flec¬ 
tion so long as it is not ‘irrational*, assuming that all costs exeluding that on actual 
enquiry remain broadly unaltered . so that the number of sample households remain 
roughly the same. That this is likely appears from the usual features, (1) for a given 
number of sample households, the less the ‘clustering* of such households the greater 
the precision : that is. a design ivhich ‘approaches’ a random sample (within strata) 
is likely to bo better, and (2) when the cost per household, of enquiry proper and of 
tabulation, is high compared to other allocated costs, as in a multi-subject enquiry 
of the type described, the average number of sample households to be selected per 
sample village is very small in an optimum design, and (3) a self-weighting household 
sample with extremely few households (one. on the average, in the oxtremo situation) 
in every sample village is ‘almost’ a random sample of households. 

143. In the above context a probability scheme may be considered as ‘irra¬ 
tional’, primarily, if it fails to utiliso the available information, to secure representa¬ 
tion from a majority of the sample villages, and secondarily, if there is very unequal 
clustering of sample households (or other units), that is,, very unequal number 
of sample households within ‘effective’ sample villages, it being also assumed that 
the scheme doos not entail much of repeated households to permit self-weighting. 
A fruitful courso for a multi-subject survey would bo to attach to each village a pro¬ 
bability which is obtained by averaging, (possibly with weights for a refined system), 
the probabilities considered desirable for independent enquiries on the constituent 
subjects, assuming the respective sizes of the sample (villages, households, etc.) to 
remain unaltered within every stratum. Particularly in case of largo deviations of 
the ‘compromise* probabilities from the ‘independent* probabilities for any subject, 
it may bo worthwhile to use the relevant information, (i.e., data for ‘independent* 
probability assignment), for a suitable ratio-estimate. Romemboring the time and 
cost requirements and the scope for errors in tho above rather elaborato procedure 
of samplo selection, it may be desirable to adopt simpler probability assignments 
like equal probability selection of villages. For a self-weighting sample this is not 
expected to be far from the optimum unless for some of the subjects (like household 
trade or manufacturing in India), a substantial proportion of the villages happen to 
bo ineffective*. Simplo probability assignment may be tho only reasonable course 
whon practically no relevant quantitative village characteristics arc available for 
use in probability assignments, as is frequently the case. 

144. The most crucial point, which is at once tho cause and tho effect of 
integration of several onquirios for economy, is the possibility opened up for a highly 
rational use of resources achieved through a process of enlargement of number of 
sample villages (first-stage units). There is simultaneous minimisation, for anv subject 
of enquiry, of number of samplo households (or other suitable second-stage units) 
both on a per village basis and in the total. This process is justified so long as the per 
household cost of data collection and tabulation is high compared to that on other 
heads, only the components specific to the particular subject of enquiry (excepting 
those on fixed overheads) being taken into consideration. For high subject-multi- 
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plicity this condition is satisfied. It is pertinent to point out that in under developed 
countries costs on tabulation using modern tabulating equipment imported from 
abroad are relatively high compared to other costs. Considerable simplicity in the 
design ensues from the fact that this process of maximisation and corresponding mini¬ 
misation can. with advantage, continue indefinitely, for a survey of sufficiently high 
subject-multiplicity, being limited only by feasibility conditions, including those im¬ 
posed by resource limitations. It should of course be remembered that consistent 
with the desired precision of some selected key items sufficient resources must be left 
for canvassing the different schedules of enquiry. Also, for the non-key items it 
appears that no other design is likely to produce in general moro precise estimates. 
Finally, ns the optimum is usually broad, one may not run gravo risk in assuming 
the validity of the above process even when the subject-multiplicity is somewhat 
inadequate. 


Fixed field-strength and sample design 

145. Permanent whole-time roving field staff of given strength poses some 
peculiar design problems. In a different situation the usual procedures of optimisa¬ 
tion lend, in a two-stage dosign, to certain sample sizes in terms of first-stago (village) 
and seoond-stngo (household) units. There, it is the implicit assumption that just 
the thoorotically minimum numbor of investigators would bo engaged. In other 
words the number of investigators should bo oqual to the theoretical total invosti- 
gator-timo requirements divided by the survey period. Obviously, there would bo 
difficulties if this number happens to bo difTeront from the pornmnent field-strength, 
as it ordinarily would. 


146. If the theoretical number is smaller than the available strongth thon 
the question of utilisation of the 'surplus' staff, who are to bo retained, remains open. 
If the scope of the survey and the not investigation time requirements cannot bo 
increased, cither by way of more intensive enquiry or by increasing the subjoot-multi- 
plicity, then one must explore the possibility of more fruitful mothods of utilisation 
of field staff in the survey itself. As there is no scopo for reducing the field costs tho 
only possibility is reduction in tabulation costs by technically sound deployment 
of the entire field staff. For this purpose the assumption roferrod to in tho previous 


paragraph would have to be suitably modified. This would mean appropriate changes 
in the parameters or coefficients in the cost-function, if not the structure of the cost- 
function itself, to allow for expenditures on surplus staff (or rathor on surplus investi¬ 
gator-time), if any. The optimisation process, which minimises costs (including 
tabulation costs) for a prescribed precision, will lead to an increase in the first-stage 
(village) sample size and decrease in the second-stage (household) sample, in a multi- 
item multi-subject survey with relatively high tabulation costs, as is usual, part.cularly 
in an under-developed country like India. The effect of thia on tho total invert.gator- 
time requirements may be one of increase or decrease depending upon the relative 
components of investigation time on enquiry proper and on overheads like journey, 
listing etc. Thus this solution, requiring engagement of all tho mvest.gators, may 
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under special circumstances even incroasc the total surplus investigator-time compared 
to the previous plan, and yet its adoption will ho the more rational course. 

147. It might appear that thoro should bo no surplus investigator-timo 
because one can increase the first-stage sample size to that extent which leaves just 
enough invostigator-time for the enquiry proper after allowing necessary time for 
journeys, listing otc. But this would not be advantageous if the savings in tabula¬ 
tions for the required smallor volume of data (for prescribed precision) are more t han 
off-set by the extra costs on other heads, viz., those on journey and haltago, (but no 
extra costs on salary would be involved). For a sufficiently high multi-item multi¬ 
subject schomc the increaso in the number of first-stage units may proceed with ad¬ 
vantage until no surplus investigator-time is left. When subject-multiplicity is 
modorato or low the position is different. A stage would then be reached when the 
rate of reduction of the volume of data may slow down considerably as more and more 
sample villages become ineffective or much less effective due to absence of sample 
households, as might happen if tho number of samplo households for an enquiry 
becomes less than the number of sample villages. Also, it is not desirable to ask the 
investigator to visit a village and moroly list the households with tho possibility of no 
enquiry on any subjoct-field or with an extremely small load of such enquiries. Under 
tho above circumstancos some surplus investigator-time may havo to be tolerated. 

148. Thero is, in actual practice, an uppor limit to tho nuinbor of villages 
which can be covered by an investigator in a given period. In a country whoro villago- 
to-village travelling is strenuous and whore board and lodging are uncertain, frequent 
movements of the investigator affect the quality of data. Also, if tho stay in a village 
is rather short thero is greater risk of tho supervisors failing to contact the investigators 
in the sample village itsolf. Conditions are such that daily contact of the supervisor 
with tho enumerator is not feasiblo. and thoro is usually some uncertainty as to tho 
exact period during which the investigator will have to stay in a given sample village. 
If the stay is too brief, tho supervisor may often find that ho is visiting tho village 
either too late or too early. The investigator must, thorofore, havo at least that 
minimum load of work in a sample villago which would not entail too frequent movo- 
mont from village to villago and would also enable tho supervisor to moot him in 
the sample village as scheduled; otherwise, ho must bo permitted to work loisuroly 
or have some idlo time. 

149. Basing on Indian oxperionco it may bo stated that, specially whon tho 
minimum period of stay in a village is not too short, oven a multi-item multi-subject 
survey of moderate intensity is definitely helpful in bringing about a situation which, 
for majority of items of information, ensures the possibility of simultaneous optimum 

or near-optimum allocation of investigation-time between first- and second-stage 
samplo units. b 


Optimality of a continuing survey organisation 

,so - 11 i3 obviously much too ambitious to speak about methods of attaining 
optimum conditions m a permanent survey organisation whon tho concept of optimum 
organisation itself is still vague and uncertain. An attempt toward" a delation 
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might ho as follows. A permanent survey organisation may be considered to bo 
optimum under a given set of restrictions when, to the extent such restrictions permit, 
tho constituent parts are determined and made to work in a manner which maximises 
the ‘utility’ of the end results. The definition is admittedly in very general terms and 
is not free from obscurities, but as a beginning it may not be unsuitable. Thero are 
difficulties,—objective measurement of utility being obviously the most intractable. 
Should the end results relate to a single round or to those for some other specified 
period? Should one think of a static optimality or a dynamic or sequential one? 
These and other relevant questions are not easy to answer. In what follows wo shall 
make a few tentative observations and touch upon only a few aspects of tho problem 
of optimisation having the above definition, however vague, in view. Strictly speaking, 
the ‘given’ set of restrictions is not absolutely inflexible, and in what raannor those 
restrictions will be altered with the passage of time in a continuing organisation is 
uncertain. But this much is certain that tho future restrictions may be influenced 
by tho prospoots held out by an efficient technical proposal, tho potentialities of which 
being at least partly demonstrated by the achievements of tho past and current tech¬ 
nical plan of work. 


151. In the previous soctions wo have made some observations on field-strongth. 
Along with tho concept of optimum fiold strongth goes tho concopts of optimum tabu¬ 
lating strongth, optimum subject coverage and optimum reporting period; and all 
these rolato to the question of optimum survey organisation. The optimisation prob¬ 
lem must take into duo account the gonoral policy or possibilities regarding tho oxtont 
to which tho field-strength, the tabulating strength and tho subject covorago aro to 
be kopt constant in a continuing survey organisation. From what has boon stated 
earlier it would appear that in developing countrios field-strongth is to bo hold fairly 
constant or increased only steadily. Tabulating machine strongth may not bo changed 
frequently, and tho magnitude of possible occasional changos will ordinarily bo in 
terms of a full complement of tabulating units and as such may not bo of marginal 
nature. Tabulation service by outside bodies may enable greater flexibility in tho 
budget for data processing. A permanent organisation, however, should control 
its processing work directly and should ordinarily depend on its own tabulating equip¬ 
ment. Constancy of tho ontiro subject coverage may not always bo possible in a 
country with poor resources. However, at tho initial formative years one may like 


to concentrate on a fixed sot of subjects. 

152. In tho previous section it has been explained why for a given fiold- 
strength it may be desirablo to have some idlo investigator-timo, tho subject covorago 
and precision requirements being preassigned. Tho position is similar in the case 
where the field-strength is to be fixed on the first occasion (for use in subsequent round* 
also) for a continuing survey with identical subject coverage. Hero again it wou o 
found that some surplus investigator-time may be a desirablo feature in 
The validity of this statement may be questioned by citing the conceivable 

r- ‘•n™ - - 

1 „ no , „„lus investigator-time if the field-strength is suitably chosen, it be ng 
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the total costs because of substantial increase in tho volume oi data. It is, however, 
by no means clear that working with increased investigator-strength would not be 
paying for a high or even moderate subject coverage. Obviously this would bo ad¬ 
vantageous so long as the additional field charges are less than tho savings in tabu¬ 
lation costs resulting from the incroase in the number of first-stage units. Additional 
field charges would include salary of additional investigators and their haltago allow¬ 
ance, if any, but not their journey costs which are likely to bo neutralised by overall 
reduction in journey for other investigators as the size of thoir investigator-zones 
would get reduced (the totality of investigator-zones covers the ontiro country). If 
tho survey is of sufficiently high subject-multiplicity the savings in tabulation would 
continue to bo moro than tho additions to field costs as the investigator-strength is 
increased until, roughly speaking, a stage is reached where some of the sample villages 
turn out to bo 'ineffective'. At this point the investigator strength may be considered 
to be optimum. 

153. In tho discussions on fiold-strength it has been tacitly assumed that tabu¬ 
lation costs for a prescribed sot of tables can be changed so that the theoretical minimum 
can be realised. As in the case of fixed field-strength there may bo fixed processing 
staff and equipment. Tho assumption therefore may not appear to be valid if tho 
processing establishment is meant exclusively for this survey. However, the validity 
of the conclusions drawn from this assumption can be restored, perhaps with greater 
justification, by changing the usual outlook in a suitablo and, it is believed, in a more 
realistic manner, provided the tabulation establishment is not unduly small. (Wo 
assume that the tabulations of data colloctod in a round of one year are to be com¬ 
pleted within a period of samo length). Tho tabulation possibilities of a multi-item 
enquiry on a group of subjects aro quite largo and it is perhaps true that tables whose 
utility is absolutely nil are very small in numbor. It appears that instead of an 
inflexible list of end-results, the various useful possibilities should be given priorities 
and tabulation programme should be flexible enough to allow a choice so as to extract 
tho most out of the fixed resources, the incidence of idle tabulation resources being 
thereby minimised, if not practically eliminated. Thus on the one hand some 
amount of idle investigator-time may be technically sound but on tho other hand, it 
is equally sound to start with a certain amount of deficit in tabulation resources, in 
the sense of a long list of tables with priorities, some being ultimately liable to be 
discarded from actual tabulation. 


at least 1! H “ Sump r0ferred *° at th0 ginning of tho previous para holds, 
at least apparently, m a s.tuat.on where there is a largo volume of stand-by' work. 

faueh work may even be unrelated to tho data thrown up by tho sample survey in any 

t^saml desfe tl W0Uld n0t ^ teChniCR ">’ SOU " d t0 ^ existence in framing 

r^ n ' ^ aUSe ° n ° mUSt try 10 maximiso tho ““lity of the total output 
of the establishment irrespective of tho source of data This would f.vm.r i 
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uncertain extent, for data on those subjects which might £ takl „p ^ at a f^tuTe 
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date for certain additional tabulations not initially required, jus has been the experi¬ 
ence of NSS with its enquiry on consumer expenditure. Direct contribution arises 
from the fjict that lesser use of tabulation resources for the survey data enables greater 
output on 'stand-by' data, and therefore of greater total output. The indirect contri¬ 
bution is related to the fact that the utility of an end-result not only depends upon 
the information content but also on the time of its release for use; and early release 
depends upon the smallness of the volume of processing. Incidentally, even with the 
expenditure of same tabulation resources one can enhance the utility of the end-results 
if the tabulations are properly phased. 


155. It will bo recalled that the application of the principle of maximisation 
of the utility of the total output of the tabulation establishment tends to eliminate 
idle tabulation hours. The effect of the application of the same principle for the 
entire organisation in relation to the elimination of idle investigator-time, which 
appeared desirable under a different set of conditions, merits close examination. 
Roughly speaking, the end-results of lower priority (utility) within a particular sub¬ 
ject-field is likely to be also of lower priority compared to end-results of high priority 
within another subject-field unless the latter luvppcns to be very much less important 
than the former. It would appear therefore that the utilisation of idle investigator- 
time in the collection of information on one or more additional important subjects 
(with practically no additions to fiold costs) would be more fruitful provided the 
processing resources utilisable for the production of low priority tables in the originally 
contemplated subject-fields are diverted to high priority tables of these additional 
subjocts. In rather exceptional circumstances it might be found more useful to uti¬ 
lise idle investigator time to produce more precise estimates for the original subjects, 
particularly for important sub-populations. Here also it would be necessary to drop 
some of the low-priority tabulations originally contemplated. 


150. Strictly spoaking, it is not a question of utilising the investigator-hours 
loft idle after covering the initially contemplated set of subjects in the best possiblo 
manner. What is desired is the choice of that sot of subjects and that sot of tablos 
which maximises the utility of the end-results obtainable by the expenditure of avail¬ 
able resources. This would generally mean a change in the originally contemplated 
allocation of investigator-time between enquiry proper and the overheads like journey, 
listing etc. An appropriate change in the number of sample villages might make avail¬ 
able adequate investigation time not only for the more important tables for the origi¬ 
nally contemplated set of subjects and for the additional ones referred to in the previous 
para but also for those on still newer subject*, (or for more precise estimates loi 
important sub-populations related to the initial subject-fields). And the not result 
may be an increase in the over-all utility of the total end-results. Pnonty 
among the entire field of subjects and end-results of interest is a difficult task, but 
this is constants being done without it being always realised. What is perhaps 
LlngTs a mor'e rational basis of choice from among different alternates, after 
lakTng a comprehensive view of their relative importance, nnfottered by exist., g 
departmentalism. 
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157. Tho growth of a continuing sample survey organisation is governed 
by several factors, somo of which are imponderable, and it may bo idle to speculate 
on its ideal size with any measure of precision. At any stage of development tho basic- 
question is what is tho most useful manner of utilisation of available resources. At 
tho same time ono should not lose sight of tho scope for higher and higher rate, of out¬ 
put, as judged by the increase in utility, with unit increase in budget, supposed to bo 
properly allocated. Under Indian conditions it would appoar that a good target in 
the first phase of development might bo to build up field staff of that strength which 
justifiably permits a large number of first-stage sample units (villages), each on the 
average with one, two or an extremely fow second-stage sample units (households) 
relatod to the populations (and in very special cases to important sub-populations) 
in respect of important types of key items of information with which tho organisation 
is concornod or is likely to be concerned. It would bo necessary to considor separately 
the more variable items from the loss variable ones. In fixing tho target it would bo 
desirable to adopt a plan of longer reporting period for tho more variable items so that 
tho enquiry on them might bo spread over two (or more) consecutive rounds so as to 
cover a larger number of first-stage units. This plan is necessary in order to keep 
tho size of the oiganisation moderate, and therefore koop tho budgot within limits. 
Tho target, basod upon the principle suggested above is not quite definite being largely 
dependent upon tho choice of tho size of tho second-stage sample per first-stage unit, 
which affocts the largoncss of the number of items which are to bo coverod during tho 
minimum period of stay (spoken of earlior) in a sample village, as also the largonoss 
of tho dosirablo number of first-stage units. Howover. rough limits, within which tho 
target budget should be. will bo indicated by this principle. The exact target in a 
specific instance will bo govorned mainly by tho resources which a country can hopo 
to mobilise. 


158. It is not an oasy task to lay down any rulo which gives tho most desir¬ 
able tabulation strength corresponding to a given fiold-strongth. Exporionco shows 
that in any socio economic enquiry tabulation possibilities arc rathor largo. Somo 
tables are more useful and some less, but it is difficult to decide at what level the use¬ 
fulness ceases to be commonsurate with the costs. Apart from tho difficulties inhoront 
in tho judgement of, literally, the worthwhilonees of a particular table thore are others 
some of which are somewhat less recondite. The same field-strength can generate 
widely difforont tabulation loads. First, tho volume of tho primary data collected 
may greatly vary as it depends upon the investigation-time allotod to enquiry proper. 
Secondly, ©von for tho same number of man-years of enquiry proper tho load depends 
upon the subjects selected for investigation, their nature and variety. For the same 
subject even, the load might vary depending as it does upon the‘selected degree of 
elaborateness and cross-classification. Finally, remembering that the utility not only 
depends upon the information content of the end-results but also on the timing of their 
release, it is not difficult to realise that even identical set of tables may require diffe- 

st z eth z ™*° fit in wuh the time - ,imit sot ° r ch °“"** 
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reviewing of the position would be necessary. Finally, it appears that replacement of 
punched-card tabulating equipment by electronic computer would change the ontire 
position rather considerably; and good deal of rethinking on the question of optimisa¬ 
tion would bo necessary. 


Concluding remarks 

159. A good deal has been stated in favour of the system which appears to mo 
to be the one preferred by Professor Mahalanobis. It would not be proper for mo to 
claim that he necessarily agrees with the views expressed herein, and it is not unlikely 
that I have missed some of the more important points which he may have in mind. 
It is also quite possible that he disagrees with some of the developments in matters of 
details about the system as it is observed at the present moment. Finally. I hasten to 
correct any impression which I might have created that his attitude is one of inflexi¬ 
bility in regard to the basic characters enumerated in the very beginning. As is well 
known he possesses a remarkably flexible mind and he is not the least hesitant to modify 
or even change a system when it is called for either becauso of increase in knowledge and 
experience, or becauso of change in the basic conditions. 

160. The basic ideas about the Indian multi-subject survey system are 
undoubtedly those of the Professor. In matters of details, however, considerable 
contributions have been made by the past and the present members of the technical 
staff of the Indian Statistical Institute, among whom special mention may bo made 
of N. C. C'hakravarty. J. M. Son Gupta, N. C. Ghosh. M. Mtikherjoo, M. Ganguli, 
R. K. Mukherjee, S. B. Sen, A. Das Gupta, S. Raja Rao. N. C. Dutta. A. Ganguly, 
R. P. Saha, R. K. Som. D. K. Bose and (Mrs) Nanjamma C'hinnappa. It is a 
pleasure to acknowledge my obligation to my colleague M. N. Murthy, who has 
made useful contributions to the development of tho NSS survey design and has 
helped me particularly in the matter of presentation of this rathor long discourse. 
Finally, I must express my gratefulness to C. R. Rao, one of the organisers of this 
Birthday Volumes forgiving me an opportunity of placing on record my thoughts on 
the subjoet-mattor of this paper. 


FITTING ASYMPTOTIC REGRESSION CURVES WITH 
DIFFERENT ASYMPTOTES 
By A. UNDER. I. M. CHAKRAVARTI and P. VUAfiNAT 
University of Geneva 


1. Introduction 

Stevens (1951) described a number of examples drawn from different branches 
of scionce, whore the asymptotic regression 

y = a+/?p*. 0 < p < 1 . 


is more appropriate than the usual polynomial regression. In the above equation, 
a ropresonts the asymptotic value oiy.fi represents the change in y when / varies 
from 0 to oo and p represents the factor by which the deviation of y from its asympto¬ 
tic value is reducod every time one takes a unit stop along the axis of /. 

In the same paper. Stevens (1951), gave a fully efficient method of estimating 
the parameters. His method consists in starting from preliminary inefficient estimates 
of tho parameter and finding the increments to be added to improve the estimates. 
With the estimates thus obtained, a second round of iteration is carried out. The 
process is continued until the desired accuracy in the estimates is achioved. To 
eliminate large portion of the arithmetical labour usually required, ho has provided 
tables for calculating the covariance matrix in the caso of equally spaced ordinates. 

The present papor treats the case whore a's are known to bo different for 
different experimental units but fi and p aro the same. The values of t in the experi¬ 
ment aro not necessarily equi-spaced. To be precise, the model used hero is supposod 
to describe k asymptotic regression curvos for k experimental units 

Vii — *i+fiptt, ... (i.i) 


where y if is tho response observed on the i-th experimental unit at the dose 

W = 2 . —» n.I » = 1, 2. k. 


We were led to this model in an attempt to describe the relationship between 
shortening in mm of heart muscles and concentration of Ca Cl 2 solution in which the 
muscle is dipped. The nature of the experiment indicated that one would ordinarily 
expect a change of scale in the original measurements from one muscle to another 
Thus while working with logarithms one would expect two curves for two strips of 
muscles to differ m the additive constant only, provided the strips of muscles aro 
sufficiently homogeneous. 
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2. Estimation 

Tho normal equations to give the least square or maximal likelihood estimates 
a it b and r of a t , 0 and p (* = 1 , 2 . k) respectively, are 

-a,n,-6 S /«+ 2 y,, = 0 , i= 1 . 2 , .... *, 


- S a, Xr'*l-bi X ^‘1+ X Xr , “y,. = 0, ... (2.1) 

•-1 i-1 • —l i-1 i-1 i-1 W 


-6 2 a, 2 —6* 2 2 r 2 ' t *~ l +& 2 2 ( tj r'« “ 1 y„ = 0, 

<-l /-l i-1 i-I i-1 i-1 ' ' 


where n, = number of observations on tho »-th individual. 


The information matrix is obtained by differentiating the expression in tho 
normal equations with respect to a„ b and r in turn, putting each y equal to its oxpcc 
ted value and changing all signs. Denoting 
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Let Y denote the matrix 


y. 



where Y/s are dofined in (2.2). 
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( 2 . 0 ) 


Then following Fisher’s mothod, one may start with the preliminary inefficient 
estimates 



... (2.7) 


The improved estimates 
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are obtained by adding to the preliminary estimates the increments 


and W. 1,...» b)SB 

whore D(l, 1, 6) has tho same meaning as in (2.4). 

Then SE b = R~ l Y-e. - (2.10) 

Thus starting with a preliminary estimate r, the first stop is to calculate tho elements 
of tho matrices ft and Y. The next step is to calculate the inverse of the matrix 
ft. Matrix multiplication ft~ x Y then, provides the necessary elements for calculating 
the improved estimates. These operations are to be repeated until the desired 
accuracy in tho estimates is achieved. When k is large, use of a computer becomes 
indispensable. 

The covariance matrix of tho estimates is given by 

V<r* = ... (2.H) 


The estimates a* of a 2 is provided by 

= £(j,-y,)*/("-*- 2 > = (Ey*—Ep5)/(w-A-2), 


( 2 . 12 ) 


where y t is the fitted value and n = L n t . 

3. Analysis of data of a physiological experiment 
Tho data used here to illustrate the method of estimation are the results of a 
physiological experiment conducted by F. Baumann and F. Waldvogcl (1902) of the 
Institute of Physiology of the University of Geneva and kindly put at our disposal. 

The object of this experiment was to determine tho influence of calcium con¬ 
centration on the force of contraction of heart muscle of rata. An optical myograph 
(Feigen, Masuoka, Thienes, Saunders, and Sutherland, 19 52 ) waa used to me«u™ the 
shortening in mm of tho left auricle (isolated and electncaUy stimulated) of tho 
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heart, dipped in different concentration of CaCI,. on sucee,».vo oeens.o s. S,x 
different concentration* of CaCL. use<l in the experiment were lUb n.M »»"">">• 
1 1 mM, 2.2 mM. 4.4 mM. 6.0 mM and *.* mM. For the pnr,».*e of statmt.enl analy¬ 
sis, these are transformed to 1/4, 1/2, I. 2. 3 and 4 respectively. Measurements on 1 
muscle strips serially numbered are recorded in Table 1. Loganthms of shorten.ngs 
in mm are given in Table 2. Charts 1 and 2 show respectively the plots of «nginal 
measurements and log transforms against concent rat ions along the abscissa.. ho og 
transform plot suggested use of the model with ‘hffore.it additive 

constants for different muscle strips. 


Estimation of the parameters involved inversion of a 23 x 23 symmetric matrix. 
A programme based on the theory of Section 2, adapted for the Computer IBM 1520 
was written by one of the authors (P. Vuagnat). The initial value of r fed into 
the computer was 0.087. At the end of the fifth round of operations, the value of r 
obtained by the computer was 0.070 802 038, the value in the previous round being 
U.07fi 020 505. As the difference between two successive values of r was sufficiently 
small, the computer was given order to print the values of the estimates, fitted values 
and the elements of the matrix K~ l , using r = 0.070 802 038. 


Table 3 shows the fitted values and the estimates with their respective standard 
errors. Chart 3 shows fitted asymptotic regression curves of the muscle strips. Judged 
by the closeness of the fitted and observed values, the model is deemed to have ade¬ 
quately described the relationship between the shortening of heart muscle and CaC’U 
concentration. 


TABLE 1. 


SHORTENING IX iam OK THE LEFT AURICLE OF THE HAT HEAKT IN 
DIFFERENT CONCENTRATIONS OF C*«0I, 


concentration 

muftclu 

no. 

i 

l 

1 

2 

1 

2 

3 

4 

1 



15.8 

20.8 

22.0 

23.8 

2 



20.6 

26.8 

28.4 

27.0 

3 

7.2 

15.4 

22.8 

27.4 



4 

2.2 

9.0 

16.G 




5 

2.0 

6.0 

15.2 




6 

5.0 

9.2 

14.2 




7 



28.8 

32.0 



8 

5.6 


26.0 




9 


15.4 

23.2 




10 

II.S 


29.0 




11 

II.0 

18.8 

26.2 




12 



26.0 

33.8 



13 



24.2 

28.8 



14 


15.0 

24.0 




15 


20.8 

29.0 




10 

1 "T 



18.2 

25.8 

30.0 

32.2 

17 

1 Q 



21.5 

28.4 

32.0 

20.6 

18 



15.4 

19.0 

19.4 


19 

Aa 



29.0 

34.0 

37.0 


20 

A 1 



22.2 

29.0 

32.2 


21 


— 

23.0 

27.4 

30.4 



29 
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TABLE 3. KITTED VALUES FROM TICK ASYMPTOTIC REGRESSION CURVES 


concentration of CnCI• 


IIIUHOlo 

no. 



0.8170 

0.3380 

0.4530 

0.0383 


I.1380 

0.8506 

0.7740 

0.0503 


1.2308 
I.3343 
I.3007 

I.1177 
I.0327 
1.1174 


value of a with 
standard error 


I .3388±0.0373 
1.4333±0.0373 
1 .4057 ±0.0443 

I .2107±0.0538 
I . 1.317 ± 0.0538 
I .3104±0.0538 


0.7020 


0.0774 

0.0413 


1.1475 


I.2053 


1.1400 

1.2610 


I.4303 
I.3710 
I.4055 

1.5605 
I.5234 
1.4203 

I.3758 

I.4070 
I.5100 


1.5277 


I .5353±0.0538 
I .4701 ±0.0000 
I 5040±0.00l2 

I .0556±0.0600 
I .0224±0.0538 
I .5253±0.0538 

I .4748±0.0538 
I .5001 ±0.0612 
I .6181 ±0.0612 


I.3420 
I.3680 
1.1884 

I.4570 
I.3754 
I .3614 


I.4334 
I.4694 
I.2708 

I.5484 
I .4668 
I.4558 


I.5555 
I .4738 
I .4028 


I .4410 
I.4670 


I .441 I ±0.0373 
I .4071 ±0.0373 
1.2874 ±0.0434 

I .5561 ±0.0434 
I .4744±0.0434 
I .4034±0.0434 


I. 2877 ±0.1074 


r- 0.07689 ±0.02.305 




r.* M **«*,,„ t K ., u „ 




Kig. 3 
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SOME ASYMPTOTIC EXPANSIONS FOR THE DISTRIBUTION 
OF THE MAXIMUM LIKELIHOOD ESTIMATE 

By Yd. V. LINNIK and N. M. MITROFANOVA 
Mathematical Institute, jAningrar! 

1 . The importance of the maximum likelihood estimate is widely known, 
especially in the large sample theory. Maximum likelihood estimate has a number 
of important properties under rather general conditions. (Cranidr, 1946; Hu/urbft'/.ar, 
1948; Kulldorff, 1957). They are : asymptotic normality, asymptotic efficiency. 
The reason of some difficulties arising when one studies maximum likelihood estimate 
consists in the fact that these estimates are defined by nonlinear equations. 

Many t hings in the behaviour of the maximum likelihood estimate have not yot 
been studied. It is sufficient to mention H. Chernoff’s hypothesis (1956) that under 
rather mild conditions the maximum likelihood estimate has its own variance conver¬ 
ging to tho right part of Rao-Cram<Sr inequality as n -* co. 

In this paper for a certain class of distribution functions with a shift puramotor 
we construct the asymptotic expansion for tho distribution function of the maximum 
likelihood estimate of the parameter (Theorem 1) and for some sot of distributions with 
a sliift parameter wc prove that H. ChornofT’s hypothesis is true (Theorem 2). 

2. Let us formulate the following well-known Theorem (Cramdr, 1946). 

Theorem A : Ia! the distribution function of a random variable X be specified 
by the density function f(x, 0) and suppose that the following conditions arc satisfied : 

(1) For almost all x the derivatives cxisl f or cier U 0 

belonging to a non-generate interval 0. 

(2) For every 0 in 0 

'« ; < Fjz) and < //(*), 

the functions F v F t being integrate over (-oo, +oo) while* f II(x) f(x, 0)dx < M, 

- 00 

where M is independent of 0. 

(3) For every 0 in © the integral *f ( -Ijj/ ) fdx is finite and positive. 

Then the likelihood equation has a solution which converges in probability to the 
true value of 0 as n —► co. This solution is an asymptotically normal and asymptotically 
efficient estimate of 0. 

3. In this paper we shall deal with function /(*, 0) of tho form ce~ F ^> 

whore 0 is a scaler shift parameter. Let x,.x„ bo n independent observations of 

X then 


L = c'e-2F[zi-*) 
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iS , ,ike,ihood function of this sample. Suppose F(x) satisfies some conditions 

", UC ! 1 We shnI1 detail ,ater - Then can write the maximum likelihood equation in 
the form 


ZF'fa—O) = 0. ... (i) 

If/(.r, 0) satisfies the conditions of Theorem A then equation (1) has a solution 
converging in probability to the true value of 0 as n-* co. Denote by this solution 
of (1). I he aim of the first part of the paper is to prove the following theorem. 

Theorem 1 : Let the true value of the parameter 0 be 0. Suppose that the follow¬ 
ing conditions are satisfied 

(1) F(x:) has k+2 derivatives (k > 0). 

(2) |F ,,, (*)| < exp (ln(|ar| + 1 )»>< with some i = 1 , 2, .... *+2. 

(3) Ee a i \*" i, (*)\< co for some a t < 0, i = 1, 2, jfc-f1. 

(4) The conditions of Theorem A are fulfilled. 

... x In Ixl 

( 5 ) — 7\xT ° 03 x ~* ±co - 

Then the asymptotic expansion takes place 

*».Vn < «> - *( 2) «-^<*) +0 ('» 5) 

where |a:| < A, A > 0, Kfix) some efficiently constructed continuous functions and k 2 
denotes Rao-Cramir limit for variance of an estimate of 0. 

The following theorem is closely related to what has been stated in the pre¬ 
ceding paragraph. 

Theorem 2 : If F(x) satisfies all the conditions of Theorem A and in addition 
F lt+2) (x) > C 0 > 0, then the B n has its own variance and 

B(6 n y/n) = 

4. Lot us proceed to the proof of Theorem 1. 

Lemma 1 : Suppose that the density function of the random variable X satisfies 
the conditions of Theorem A and condition (3) of Theorem 1 with k = 1. Then 

r(l».-*.l> £-)<•- 

where * < p < i, a is a positive constant depending on pand O^denotes the true value of 0. 

Proof: From the proof of Theorem A (Cramdr, 1046) it follows that for arbi¬ 
trary values of 6 and S the maximum likelihood equation has with a probability exceed¬ 
ing 1 — 6 a root between the limits ( 0 o —S, 0 o +8) as soon as n > n 0 (S, s). Let 

$ _ n * an d n be fixed. Find out how € depends on n. Rewrite (1) in the form 

B 0 +B x (e-0 0 )+ lJB t (0-0 0 ) 2 = 0 
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and |/?j < I. The n is chosen so that 


'aw , B, = Is //,*., 

o = o» 



^. = ^<|Bol >S*)< *£. 


p t = r( Bl >-!««)< ^ 


^ = ^(15,1 > 2U)<l t . 

Observe that 

Pt = P(P, + *‘ >1*') < P(B,+k « > i «M>) 

and 

P > - P(\B\ > 2J/) > f>(|B| > 

It follows that it is 

sufficient to choso f so that P x < * f. 


I ho largo deviation theoron) gives us 

p t - p( L s HeA I . n* \ _ (1/ 

\ v " 30 I.-.. w ) = 0( * > 

as desired. 7 

Further we shall consider functions F(x) which satisfv .11 th «•»• 
Theorem 1 . Since Fix) has 4+2 derivative y conditions of 

bo written in the form 1 ,uax,mum likelihood equation cun 

ut . + <K 5 ^^--o. ... w 

(It is convement for the future to divide both parts bv „ 1 P t 

tHal ^ th0 Prob “ bUity •—« * — - rootTsuch X7 

Lot us considor the oquation 

0 +...+ (-*)*:' „ 

” kl n<^* = 0. ... (3) 

en0tC ** = O. = 

Notico that „ r din f 

a i - J - ^ /dx = 0. 

With this notation equation (3) takes the form 

X (^ 0 +...+ fc*£ -o^+... + tllp 

' 4! a *+i a * 0- ... (3'J 
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Introduce the following condition 

r.:\lz\ < » r . 2= 1 .*+l 

where s is a small positive number. From the large deviation theorem we got 

P(f r ) < e-"\ 

Equation (3) is algebraic in 0. With the help of Newton polygon Chebo- 
tanev (1948) we construct the power expansion of 0 in 

0, = a„+a, +<H ±+... • 

Here a 0 is a real root of the equation 

Let us construct the expansion in which a 0 =* 0. 

“>= a, ] 

The a, is a form of degree < in 5, ... 5, >f* < *+l and » a form of degree sin 5..-. Ui 

if r > -t+ 1 containing at most Cj> +1 terms. It is cosy to verify that «,=«, • a, (a,. 

a**,) and that under condition r, the scries 


VnO 


1 4.L& 




(S+*a«) + - 


... ( 4 ) 


uniformly converges in a certain neighbourhood of the point Z = J. - 0. 

Lemma 2 : The root t n of (2) and the root 0 , of (3) for which a„ = 0 with the 
probability, «c eediny condition r. die ^uaiity 


c 


|0n-<M < n (dV. W 


-* ’ 


... (5) 


C is a constant dependinrj on n and , is a small pas,Vice number dependiny only 
on £ and p. 

Proof • Let us introduce the condition L : |*<1 < hi n, t — l, 2, .... n. ® 
probability of this condition not to take place, accordingly wth suppos.t.on (3, 

of Theorem 1 dose not exceed 


2 j e-‘* n *dx < f *“ to " dx - ^ 

lo’l 


_J_ T = o l± M ) 

TKlnn) ,n — 1 \n*' 
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where K is any positive number. The difference between (2) and (3) will be 


~~7~ (-UL-Oi)+- + 


(—I)*" 1 


(9J-»f)) 


s/n ' .. k\ 

+« 1 I«.-» 1 )+-+ —£f ' “tnlP-Oi)+/**.) = u 
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(«» 


and 


pM = (t+T)! * -n-’ 


Supposition (2) of Theorem 1. the conditions L and r, and Leminu I provide 


|*lj| <c«^-««££-" 


«*+!M Q 


*!«♦ I »/4|-* 


Since we may choose p as near to 1 /-i as desired; where C docs not depend on n. 
Divide the both parts of (6) by d m —0 x 


1 (-1 + . l-')*- 1 r 

5,1...+ M 


(—o*- _ 8i-$t P,(9.) 

9.-0, 9„-o, 


-<■,+ ...+ --J,— a,., V + 


0. 


Two cases may arise 




(2) \K-0 X \ > 2 • 

But tho second case implies that 


*<*> a t . 

K-0 X w 2 ’ 


and since 




\/n*- 


the loft part of (6) has the order of a 2 and n tends to infinity and does not equal to zero 
Now consider 

^ = a ' +a '-7t + - + “-( ?5 )* +«* 1 ps )'“ ‘ 


Hero 


— A+/*t 


is a uniformly converging series under r, in a certain neighbourhood of Z 2 = - L = 0 . 
R ln obviously has a finite dispersion when r f holds. 


o-isi#,).... 


(7) 


30 
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Note that 

- P(a * + - +a » 1 (>n)'<*) -•(£■)'• 

In fact 

)/-+*..( '<*) 

= *>(«,+...+«,♦,( )'+,*+*..( ^)' + '<*. |1+B,.|< »*) 

+ I («, + ...+«,♦,( j +/i+/?, w ( ) < x, |I+^m|>n c 

< P(“. + -+«m( ^)‘<*)+0( (A7 ?j, +j ). 

Similarly 

= />(«,+.i-)‘< *, |l+B,.|<n«) 

-i- J < x, |l+^in| > n r J 

< />(«,+...+«„,( ^ )W*,.( y n )■"< *) 

+/>(*<«,+...+«*,(^ /+/*+*..( js r* <*+ (v ^ r .) 

-J.) +/'+*<■( vr) <*)+°( ^ ; ) • 

Since 

P(O m V* <x) = P{6y/n < *)|r„ L.|0„| < ). +0^) 

taking into account the previous notation we get 

l>(9„Vn < x) = P («,+“. v ‘- +-+“«« ( V ‘ B )< *) +0 ( ) ■ 

Lemma 3 : Let the function F(x)= F\x) satisfy all the conditions of Theorem 1. 
Then the variance-covariance matrix of the vector {F(X), F l * l (X)}, z < k -\-2 is 

nonsingular if for any i = 0, 1, the /«»(*) is not identically constant. 
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Proof: From Polya i Segey [1956, N63, § 5] it follows that M , whore 

M = \\ c f (F^(x)-EF^\X))(F lt >(x)-EF^(X))e~ Pi,t dX\\. 

vanishes if and only if the functions are linear dependent, that is when /’(x) is a solu¬ 
tion of tho equation 

+ f e-'^dx-Ao f F(x)t’ F, ''dx- ...-A, / F^t-^dx = •». 

... ( 8 ) 

with some set (A 0 ...A,), A, ?£ 0. The general solution of this equation is expressed 
by linear combination of the functions If at least one of ^ 0 the 

solution does not satisfy conditions (2) and (5). If all the v { =0 then F(x) is a poly- 
nom. But a polynom obviously is not a solution of (8) if its degree exceeds 2 . 
Consider tho probability 

p = p ( a >+«* 

A theorem given by R. Rao (1961) provides 

r-Z .»- f dp ^)+ 0 (v:) 

We can apply this theorem bocauso of Lemma 3. Denote by V tho variance-covari¬ 
ance matrix of tho vector .5 t+1 ) = Z. 

Consider a separate term of this sum 

f dPA-*) - <2>t)**> 

« t+ I ' \«-»/* 

{P,(.<) exp[it’Z-it‘ V-'(\d+)dZ 

I 1 

«.+■•.+«(«*-) 

= { ( { oxp il’Zdz)- 

<,, ie,-|<„■ 

x'P^il) exp + 

The transformation 

*»" a,+ *s4 

** = it 


u k*i — it+i 
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is a monotonic substitute of variables as *' preserves the sign when a is sufficiently 
large and r c takes place. 


and since 


. 

l&l = <»% 

J exp tt'ZdZ 

“ ,+ai Vn +" +«C<*-l)/t|+l(^r) < * l>/2 <* 


is a eonv 


verging power series in which may be integrate term by term. Combin¬ 
ing the similar terms in each expansion wo get the desired result. It is easy to verify 

that the first term of this expansion is - f e-**/ 2 * ! dx. 

V2ttk -<*> 

5. Let us proceed to the proof of Theorem 2. Being a root of (2), 9 n satis¬ 
fies the inequality (Okunev, 1958) 


- Tgl .* + ‘ (>-=!» ?*”<*«> 


+ 1 


I 


-f-n 2 

(»-!)! 1 ^ (ft—1)1 


l 


M 


c " n • (i+Tji 


y/n 


2!^ 


(i-1)! 


?. + 2 


l°<l 

(i-i)! 


<?o 


+ 1 . 


(*+!)! 


It follows that 


.. 


and 9 n has its own variance. 
Further 


f $*(*„ ..., *„)/(*», .... =[9l (x x .*„)/(*„ xjdx -f f 8*(x x , .... *„) 

J a A 


f{x lt ...,x n )dx 
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The region A is definod by tho conditions 

or I I > K for some i, i •= 1,.... k +), 

or \ x i | > In n for some t, i * 1 ,.... n . 

or I 9. ! > X- . 

y/n 

Jn the region where | 9. | < the whole integral are trivially evaluated. 

Consider the region 

or I Zi I > n' for some «, i = 1 , .... fc+i 

or I | > In n for some *, * = l, n . 

The soparate item of the first sum is 


if im.1 /■** 


M„. f f 15, 

Bl ®< ;: aw 
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1 lie first item in the right part docs not exceed the second one and is evaluated by the 
lollowing manner 


n J , 
lCi| > n c 
101 <»' 


lUj I fdx 



U<l >»' 


15.1 /«**<£ \ \U\fdx 

»' < I ft I < 


+ "' 1 15i I fdx < P(A ) + n'P(A ) + f ~ F ™dx 

l*‘-<.J>l > Vn |xj| >lnii 



wlicre K is any positive number. The items of other sums in the right part of (1») 
can be evaluated similarly. Thus wo have 


.*.)*t-o( n ^) 

A 

E6l ~ \ (“V» + - + R -(Jn)'^ fdX+ °0 

A 

- iW' - *+ f«A/-+...+°( 5 J 5 

A 


“ i Ea ' + ^ B ^' + °{nV n )■ 


Since 


g-M _ p « _ = 1 

‘ al [PW 


K *. 


Theorem 2 is proved. 

Remark : In fact wo have got tlio asymptotic expansion for the variance 
of the maximum likelihood estimate and the way of finding its terms. 
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A GEOMETRICAL PROBLEM RELATED TO CYCLIC DESIGNS 

By MOTOSABURO MASUYAMA 
Meteorological Research Institute, Tokyo 
and 

Institute of Physical Therapy and Internal Medicine, Tokyo University 

Suppose that a circlo of perimeter v is divided anti-c lock-wino into k arcs of 
positive lengths d v d t , ...,d k in this order. These are called arc lengths of the first 
stage. The sums of two successive arc lengths in tho first stage, i.e., 

d|+d 2 , d,-fd a . ...,d k -\-d x 

are called arc lengths of tho second stage. Tho 9ums of threo successive arc lengths 
in tho first stage, i.o., 

d|+d 2 -f-d 3 , d t -f d a -|-d 4 , .... d k -\-d l -\-d t 

are called arc lengths of the third stage and so on. At last arc lengths of tho (k— l)-st 
stage are defined by 

di+dj+'-d-d^j, d s +d, j- \-d k , •••, d^-f-dj+ •••-{- d k _ s . 

If k arc lengths of tho first stago are given, all these (k*—k) arc lengths are 
determined uniquoly. 

However, as 

(1) the exchange of suffixes among arc lengths of the same magnitude, 

( 2 ) the cyclic chango of their suffixes, corresponding to tho rotation of tho 
original circle around its conter, and 

(3) the inversion of their suffixos, corresponding to the turn-over of the original 
circlo around any axis through its contcr givo tho same (**-*) arc lengths us a whole, 
the converse is not true. 

In the following section we shall provo that tho converse is truo for it = 5, 
except ( 1 ), ( 2 ) and (3). In tho previous paper (Masuyaina, 1962c) wo proved the 
theorem for k = 2, 3, and 4. In this paper tho method of approach is slightly 
unproved but more elegant method is needed for k > 6. 

Suppose that there are two solutions (d» d . ,d t ) and (D„ D. . D t ). 

Let one of minimum arc lengths bo *. As the total number of minimum arc lengths 
is the same in beth solutions and all these lie in the first stago, wo can assume with- 
out loss of generality 


= = D x . 
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(1) Let us assume that there is only one minimum arc length in each solution. 
Then arc lengths which contain x are 

x; x+d 2 , x+d 6 ; x-\-d 2 +d 3 , x+d 4 +d 6 , 

x+d t +d s ; x+d 2 +d 3 +d 4 , x+d 3 +d 4 +d 6 , 

x+d 2 +d 4 +d 4 , x+d 2 +d 3 +d s ... ( 1 ) 

in one solution and those in other solution aro (1) with D in place of d. 

As we may change x independently of other arc lengths in the first stage, 
so far as x is positive and minimal, assuming that v changes with x, any symmetric 
function of (1) is invariant when d is replaced by D. 


Tho convention is adopted that E* denotes the sum of the A-tli powers of 
elements in ( 1 ). becomes 



6(d,+d 6 )+4(d 9 +d 4 ) = inv. 

... (2) 

As 

H 

II 

1 

5‘ 

< 


and 

- \-d 3 = inv. 

... (3) 

wo have 

dt+d 3 = inv ( = A > 0) 

... (4) 

and 

d 3 +d 4 = inv (= B > 0). 

... (5) 


Now lot y and z bo arc lengths in tho position of d 2 and d 3 respoctivoly. Then 
tho symmetric functions of 

y,A-y\ y+z, .4+B-(y+*); 

B+y, A + B—y, A-{-B—z, A—z ... (6) 

are all invariant. Z 2 and S 3 give 

3y 2 +2z 2 —{ZA + B)y—{A + 2B)z+2yz = inv ... (7) 

and 3 (A + B)y*+( 3>1 + 2 B)z* 

-L4+£)(3,4 + £)y 

-[2(A + B) 2 -A*)z +2(A+B)yz = inv .. (8) 

respectively. By eliminating y* wo have 

Az(z—B) = inv. •• (0) 

As A > 0, (9) means d 3 d 4 = inv. 

By (5) and (10) it follows that 

(i) D 3 = d 3 and D 4 = d 4 

(ii) D 3 = d 4 and D 4 = d 3 . 


(10) 


A GEOMETRICAL PROBLEM RELATED TO CYCLIC DESIGNS 
In the first case, let us denote anew 
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d l = D x = a, d 2 = 1, d 3 = IJ 3 d: b. 


</, = />, = c, d i = A—I, 

then E 2 and S 3 of 

I, A— I ; a+/, b+t, c+A—t, A+a—t ; 
a+6+/, b+c+l, b+c+A-t, c+a + A-t ; 
a+6+c+/, a+6+c+-4-/ ... (11) 

give — 3A+b — c)t = inv ... (12) 

and 3(i4-l-a+6+c)/* 

-(3ylH3Aa + 2i464-4i4c+a*+o6+3<ic+26c-f 2c*)> = inv ... (13) 

respectively. By (12) and (13) \vc have 

(a+6+c)*/ * inv, ... ( 14 ) 

/ - d, =- D t , ... (15) 

from which it follows by (4) d h -= T) % . ... (16) 


In the second case we rename D v D t . D # as D v D s , D 4 . D t and the case 

is reduced to the first one. 


(2) Next lot us assume that there are only two minimum arc lengths in each 
solution in such a way that 


- d t = Z>| - D t =4 *. 

Then wo have d A - />« =» inv ( ± D > 0) 

and dj+rfs - inv ( a B > 0) 

in placo of (4) and (5) respectively. Let y be the arc length 


... (17) 
... (18) 
... (19) 

in the position of d 3 , then 


gives 

or 

31 


x+y, E + x—y; 2 x+y, D+x+y, 
D+E+z-y, E+'2x-y ; 
B+2x+y, D+E-2x-y 
y z —Ey = y(y-E) = inv 
djd 5 = inv . 


( 20 ) 

( 21 ) 

(22) 
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By (19) and (22) 

(i) D 3 = d 3 and Z> 6 = d & (the rotation) 

an< * (ii) D 3 = d 3 and D s = d 3 (the turn over) 

are only possible solutions. 

(3) We assume now only two minimum arc lengths in each solution such that 



d, = d, = D t = D, =4 x. 

... (23) 

Then it follows 

that d 2 = D 3 = inv (= F > 0) 

... (24) 

and 

rf 4+<*6 = inv (= O > 0). 

... (25) 

Let y be the arc length in the position of d A . By of 



y, O — y, F+y, O+F-y, F+y . F+Q-y, 

... (26) 

wo havo 

y*—Gy = y(y—G) = inv 

... (27) 

or 

d A d & = inv. 

... (28) 

Thus 

(i) D a = d A and Z) 5 = d 3 (the rotation) 


and 

(ii) D a = d s and D 3 = d A (the turn over) 



are only possible solutions. 

(4) Now let us assume that there are three minimum arc lengths such that 

d, = d, = d, = Z>, = D, = jy,ix. ... (20) 

Obviously by (3) we have 

d A +d 6 = inv (= O > 0). ... (30) 

This case is a special case of the third. 

(5) Assuming that there are only three minimum arc lengths such that 

d, = d, = d. = Z>, = D, = D, ± X, ... (31) 

we have by (3) <*,+<*. = <=£>«). (32) 

This is reduced to the second. 

Other cases are either trivial or reduced to these five cases, except the possi¬ 
bilities which will be discussed presently. 
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(6) Let us count the frequencies of Ox, lx, 2x and 3x which appear in each 

stage. 


case 


stage 


total 

1 

2 

3 

4 

I 

Ox 

4 

3 

2 

1 

10 


lx 

1 

2 

3 

4 

10 


2x 

0 

0 

0 

0 

0 


3r 

0 

0 

0 

0 

0 

II 

Ox 

3 

2 

1 

0 

6 


lx 

2 

2 

2 

2 

8 


2x 

0 

1 

2 

3 

6 


3x 

0 

0 

0 

0 

0 

III 

Ox 

3 

1 

0 

0 

4 


lx 

2 

4 

4 

2 

12 


2x 

0 

0 

1 

3 

4 


3x 

0 

0 

0 

0 

0 

IV 

Ox 

2 

1 

0 

0 

3 


lx 

3 

2 

2 

0 

7 


2x 

0 

2 

2 

3 

7 


3x 

0 

0 

1 

2 

3 

V 

Ox 

2 

0 

0 

0 

2 


lx 

3 

4 

1 

0 

8 


2x 

0 

l 

4 

3 

8 


3x 

0 

0 

0 

2 

2 


This frequency table shows that no two of these five eases are identical. For example, 


d, = d,-D l -D, ! Lx < Other are lengths in the first stage cannot occur. 
Thus our theorem is true for k = 5 . 

of a I,lock In C , 0n8l ™ Cling Cy ° UC d0SignS ’ 0Ur P roblcm » to find the solution J 
19620^ (Masuyama. 1959, 1961a. 1961b, 1961c, 1961d, 1962a, 1962b 

*** = 6 ’ — (33) 

* 6 a g,rCn b '° Ck ” nd elemcnts in blocks being those of a module ffl. 
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Lot us take residues to the modulo v as a module, then our theorem states 
that the solution £ of this equation (32) is unique for block size $(£) =2, 3, 4 and 5, 
except its conjugate £• and its shift {«}£, s being an element of fi[. 

Let x t for * = 1,2. k be elements of £ and rx t be those of r£, r being 

an automorphic mapping of x, e HI. It follows that 



r(££*) = (t£)(t£*) 

- (34) 

ftl being residues to the modulo y. 

if (£ in (33) is invariant under this 

mapping, i.e., 

there exists s or tef tl such that 

r<£ = <£. 

... (35) 


r£ = {«)£, 

... (36) 

or 

** - m 

... (37) 


holds for s(£) ^ 5 and for any rational integor v, so far as * 4 'a in £ are mutually dif¬ 
ferent. As the mapping ► —x i is automorphic,(37) is reduced to (36) by this mapping 
applied on both sides of (37). For example the multiplication by m which is relatively 
prime to v induces an automorphic mapping r m in HI. As the multiplication by 
(y— 1) which is always prime to v induces the mapping x ( -* —x it (37) is reduced to (36) 
*>y r mt in place of r m . 
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INCREASE OF HUMAN STATURE IN INDIA AND ELSEWHERE 

By N. T. MATHEW 
Army Statistical Organisation, New Delhi 

Summary 

Records of stature of 38471 army recruits from the Punjab are analysed to 
throw light on significant components of variation associated with age, community 
and district. The secular change in height is significant and is of the order of one 
inch in twenty-five years. Similar changes are noticed in some other states in India. 
Increase in human stature at the same rate as appears to be taking place in the 
Punjab now, were noticed in Japan and the United States in the present century and 
in countries in Europe in the middle of the last century. 

Introduction 

When Professor P. 0. Mahalanobis started work in the twenties of this century 
the science of statistics in the modern sense was almost unknown in this country. 
Today there is widespread awareness of the importance of statistics in all fields 
of human activity. For an article in this volume commemorating the seventieth 
birthday of a scientist who has contributed so significantly to the growth of stature 
of workers in the theory and practice of statistics during the past half a century, 
an examination of the objective evidence regarding increase in human stature in 
recent times may not be inappropriate. 

ANTHROrOMETRIO STUDIES 

Of the many fields which P. C. Mahalanobis has enriched by his work anthro¬ 
pometry was one of the earliest. The chief focus of all the early work in anthropo¬ 
metry was on the study of differences and similarities among racial groups. 

In 1921 Karl Pearson* had suggested a test for the divergence hot ween two 
groups of multiple measurements, by means of what he called the 'coefficient of 
racial likeness,' (C*). This co-efficient cannot, howovor, be used as a measure of 
distanco between two multivariate populations; its sampling distribution cannot 
be easily determined. The introduction of the Z>*-statistic by Mahalanobis (1930. 
1936) was a significant contribution, because it gives a true measure of distanco, in 
the sense of a metric, between two populations, besides providing a test for group 
divergence; the Z) a -statistic, also lias the advantage of certain properties of invariance 
and its sampling distribution can bo easily determined. Using the Z> a -statistic, it 
has been possible to compute rolative 'distance* between several groups, racial or 
otherwise characterised by multiple measurements on individuals, and to study 
group configurations. 

Stature is perhaps the anthropometric characteristic least difficult to measure 
on large numbers of people though it may not bo the most satisfactory for discrimi- 
nation be tween different groups. For a comprehensive study of the variation of 

•So® Tildoeley (1921) and Poor-son (1926). 
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human stature in India, data was collected at the Army Statistical Organisation 
on a out 18,000 candidates for recruitment every year from 1948 onwards. The 
port,on of tins material relating the state of Punjab for the years of recruitment from 
i J48 to 1955 is used in this paper. Work on the other states is in progress and it 
is hoped to incorporate the results in a later publication. 

Accepted and rejected candidates 
The total number of measurements from Punjab is 38471 including those 
who were accepted as recruits into the army as well as those who were rejected. That 
there is no evidence of significant difTerenco between these two groups can be seen 
from Table 1 which gives the frequency (in one inch intervals of height) of accepted 
and rejected candidates for rocruitment. 


TABLE I. DISTRIBUTION OF HEIGHT COMPARING ACCEPTED AND 

REJECTED CANDIDATES 


hoight in incho* 


number of recruit* 

porcentogo 

total 

accepted 

rejected 

accepted 

rcjoctod 

(1) 

(2) 

(3) 

(4) 

<S) 

(0) 

36.0-36.9 

1 

1 




57.0—67.9 

4 

I 

1 



58.0—58.9 

6 

3 


0 5 

0 5 

59.0—39.9 

17 

7 

4 



60.0—00.9 

160 

73 

53 



01.0—61.9 

362 

147 

95 

0.8 

0.8 

62.0—62.9 

942 

407 

281 

2.2 

2.4 

63.0—63.9 

1974 

900 

541 

5.1 

4.0 

04.0—64.9 

4441 

2121 

1399 

11.3 

12.0 

65.0—63.9 

5357 

2710 

1695 

14.4 

14.5 

00.0—06.9 

8790 

4299 

2721 

22.8 

23.3 

67.0—67.9 

6583 

3317 

1998 

17.6 

17.1 

68.0—68.9 

6402 

2264 

1422 

12.0 

12. 

09.0—69.9 

2738 

1394 

796 

7.4 

0.8 

70.0—70.9 

1383 

062 

407 

3.5 

3.5 

71 .0—71.9 

631 

323 

185 

1 .7 

1.0 

72.0—72.9 

184 

101 

50 


73.0—73.9 

67 

34 

20 



74.0—74.9 

15 

7 

5 



75.0—75.9 

8 

1 

6 

0.7 

0.7 

76.0—76.9 

1 

_ 

1 



77.0—77.9 

2 

| 

1 



78.0—78.9 

3 

1 

2 



total 

38471 

18834 

11683 

100.0 

100.0 


For 7954 candidates information about acceptance or rejection is not available. The 
percentages shown in columns 4 and 5 exhibit remarkably close agreement. The 
value of A' 2 for 13 degrees of freedom is 14.97 which is not significant. We shall 
therefore, assume either that stature has not been an important element of discrimi¬ 
nation between accepted and rejected cases, or that those who are deficient in height 
do not volunteer for recruitment or that they are rejected outright without even a 
chance of their particulars being recorded in the registers from which all the present 
data were extracted. The average height of accepted candidates is 66'.51 and that 
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of rejected candidates is 66' .46. In ail further analysis we shall ignore the distinction 
between accepted and rejected cases. 

The main finding which we desire to present in this paper is that there is 
some evidence of an increasing trend in the stature of the population of Punjab. 
However, before dealing with this question we shall bring out to the extent possible 
variation associated with groupings on the basis of age, communities and geographical 
regions. A clear-cut analysis of the effect of these factors individually is not possible 
without prohibitively laborious calculations. What is attempted here is only simple 
'analysis of variance' taking the factors one at a time. 

AOE OF RECRUITS 

The recruits included in the present study have age from 17 to 3">. It is 
well known that a large part of the growth in stature of human beings takes place 
before the age of 17 though some increase continues perhaps upto the age of 25. 
For convenience we have divided the range of age into ten groups, namely seven 
individual years of age from 17 to 23. and the groups 24 to 25 26 to 30 and 31 to 35. 
This provides more or less adequate numbers in the different groups by clubbing 
together small numbers in the individual ages at the tail end. 

The total variation in staturo can be a summarised by calculating the sum 
of squares from the means which in tho present data amounts to 169657.79 for 38470 
degrees of freedom. This leads to a standard deviation of 2.10 inches. The sum 
of squares corresponding to the 9 degrees of freedom between the age groups comes 
to 1428.42 leaving 168229.37 ns the sum of squares within age groups. The mean 
squares between and within age groups work out to 158.71 and 4.37 respectively 
giving a variance ratio of 36.32 which indicates the very high significance of differ¬ 
ences between age groups. We are not in a position to say what part of this signifi¬ 
cance is due to the effect, age. independent of other factors. The analysis has been 
carried out separately for each of tho communities having more than 200 recruits 
in our sample. Results arc given in Table 2. 


TAliLE 2 ‘ ANALYSIS OF VARIANCE OF STATURE BETWEEN AND WITHIN AOE GROUPS 


community 


d.f. 





m.s. 


ratio 


B 

W 

T 

B 

W 

T 

B 

W 

B/W 

(1) 

(2) 

(3) 

(4) 

(3) 

(6) 

(?) 

(8) 

(0) 

(10) 

Dogro 

Punjabi 

Sikh (Bchodulod castes) 
Sikh (othora) 

9 

9 

9 

9 

7072 

7827 

5517 

10150 

7081 

7830 

5526 

10159 

433.12 

536.80 

288.00 

511.37 

25981.43 

31797.49 

20126.49 
40543.77 

26414.55 

32334.29 

20414.58 

41055.14 

48.12 

59.64 

32.01 

56.81 

3.67 

4.06 

3.65 

3.99 

13.11 

14.68 

8.77 

14.23 

Jat 

Rajput 

Ahir 

Gujar 

total 

9 

9 

9 

9 

9 

4092 

813 

2633 

205 

38461 

4101 

822 

2642 

214 

38470 

180.96 

141.66 

54.40 

35.01 

1428.42 

14216.61 

3282.17 

9116.24 

580.14 

168229.37 

14397.57 

3423.83 

9170.64 

615.15 

169657.79 

20.10 

15.74 

6.04 

3.89 

158.71 

3.47 

4.04 

3.46 

2.83 

4.37 

6.79 

3.90 

1.75 

1.37 

36.32 
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Differences between age groups are significant in all communities except 
Ahirs and Gujars. For Gujars the data is scanty and for Ahirs the variance ratio 
is very near the 5% level of significance. Mean values of stature in age groups for 
different communities and for all communities put together are presented in Table 3. 


TABLE 3. MEAN STATURE OF EACH COMMUNITY FOR DIFFERENT AGE GROUPS 


community 





ago 

group 





17 

18 

10 

20 

21 

22 

23 

24-25 

25-30 

31-35 

(I) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

(9) 

GO) 

(II) 





number in the snmplo 




Dogra 

324 

1034 

811 

864 

008 

714 

541 

085 

778 

433 

Punjabi 

084 

088 

800 

010 

803 

787 

071 

740 

828 

621 

Sikh (schoduled castes) 

010 

705 

081 

608 

Oil 

523 

440 

404 

453 

300 

Sikh (others) 

071 

1501 

1084 

1 107 

023 

030 

880 

1000 

1134 

712 

Jat 

340 

608 

518 

408 

300 

308 

287 

347 

474 

350 

Rajput 

70 

118 

80 

80 

70 

74 

48 

80 

no 

57 

Ahir 

313 

380 

411 

300 

200 

200 

170 

187 

230 

105 

Gujar 

18 

44 

23 

15 

0 

20 

7 

10 

30 

33 

total 

3244 

5451 

4300 

4505 

3783 

3500 

3073 

3012 

4050 

2045 






moan height 





Dogra 

04.80 

03.25 

65.53 

65.32 

03.00 

65.33 

05.13 

05.00 

04.90 

05.09 

Punjabi 

03.58 

60.10 

00.37 

60.34 

00.18 

00.14 

85.04 

05.82 

03.75 

03.09 

Sikh (schodulod castos) 

00.28 

00.45 

66.67 

60.07 

00.50 

00.44 

60.12 

00.02 

00. 13 

00.00 

Sikh (others) 

07.01 

67.08 

07.31 

..7 20 

07.27 

07.20 

07.24 

00.80 

00.07 

00.81 

Jat 

00.03 

07.23 

07.20 

07.38 

07.54 

67.52 

07.70 

07.10 

07.39 

07.40 

Rajput 

00.00 

06.68 

60.30 

07.40 

00.85 

00.32 

00.37 

00.91 

00.09 

00. 19 

Ahir 

67.13 

67.34 

07.32 

67.32 

07.38 

.,7 n 

07.14 

07.00 

00.39 

07.04 

Oujar 

60.57 

67.10 

67.00 

68.00 

07.30 

07.00 

07.45 

07.42 

07.03 

00.73 

total* 

66.20 

60.50 

06.00 

06.00 

06.05 

66.53 

00.43 

00. 19 

00.20 

06.20 


*includos also communities with less than 200 recruit* from Punjab. 


The maximum stature is in the age group 19 for all communities together, 
as also for Punjabis, Sikh (scheduled castes) also Sikh (others). Other communities 
show maximum stature at 20 or 21 except Jat* who have their maximum at age 23. 
There is a decrease in stature in higher age groups. Chart 1 presents graphically 
the variations in average stature for all communities at different age groups. 
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Chart I. Mean height at different ogee of recruits from Punjab. 
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Communities 

In the foregoing analysis we have used the term community to denote groups 
some of which are religious and regional like Punjabi Hindus, and Sikhs while others 
like Dogras, Jats, Rajputs, Ahirs and Gujars have also a racial meaning in the sense 
of being descended from a common set of ancestors. That community differences 
have some connection with stature can be seen from Table 4 giving the analysis of 
variance between and within communities. At each age group as well as for all 
ages together the variance between communities is highly significant. 

TABLE 4. ANALYSIS OF VARIANCE OF STATURE BETWEEN AND WITHIN COMMUNITIES 



24 — 25 
20 — 30 
31 —35 


2240.43 
2915.15 
1985.38 
2879.89 
1070.02 

2145.44 
2270.13 
1889 50 
2752.91 
1032.04 


|10800.00 
.17050.07 
15302.02 
10098.92 
13532.27 
14584.17 


15058.22 

17774.87 

11911.50 


13101.03 
19905.82 
17347.40 
19578.81 
15202.89 
10729.01 


17547.78 

20527.78 
13544.20 


248.93 3.36 
291.51 3.13 
220.00 3.41 
239.99 3.71 
130.21 3.68 
195.04 4.00 


12407.92 14084.05 227.01 


171.78 4.36 
275.29 4.40 
148.42 4.52 


38.88 


30.40 


21542.79 148115.00 


1 he averages of stature for different communities are given in Table 5. 


TABLE 6. AVERAOES OF STATURE FOR 
DIFFERENT COMMUNITIES 

"community “ N 


Oorkha 
Dogra 
U.P. Hindu 
Punjabi 
Mnlayali 

Sikh (schoduled cost os) 

Rajput 

Sikh (others) 

Oujar 

Ahir 

Jat 

other 


03.05 

65.24 

65.58 

66.02 

66.30 

66.38 

66.63 

67.08 

07.16 

67.29 

67.36 

66.90 


total 


38471 


66.46 
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The tallest community is Jat with an average height of 67". 36 followed by 
Ahirs (67".20), Gujars (67". 15) and Sikhs (others) (67".08). Gorkhas who have the 
lowest average stature are represented by only 28 recruits in our sample. Similar 
is the case with U.P. Hindus and Malayalis who probably are newcomers to Punjab. 
Dogras (65". 24) are the lowest statured among the major communities, Punjabi 
Hindus (66".02), Sikhs (scheduled caste) (66*. 38) and Rajputs (66*.53) are of medium 
stature. The communal differences are represented graphically in Chart 2. 



Geographical variation 

Differences among districts may perhaps be regarded as reflecting the effect 
of environmental factors, though in our present data these will be masked by non¬ 
homogeneity in respect of community and age. Analysis of variance between and 
within districts shows that differences among districts arc highly significant. In 
Table 6 the results are given separately for each age group and in Table 7 separately 
for each community. 


TABLE 0. ANALYSIS OF VARIANCE OF STATURE BETWEEN AND WITHIN DISTRICTS 




d.f. 



a.*. 


m.s. 

rotio 

B/W 

ago 

B 

W 

T 

B 

W 

T 

B 

W 

(1) 

(2) 

(3) 

(4) 

(6) 

(6) 

(7) 

(8) 

(0) 

(10) 

17 

20 

3223 

3243 

1528.04 

11572.98 

13101.02 

70.40 

3.69 

21.28 

18 

22 

5428 

5450 

2299.68 

17666.14 

19965.82 

104.53 

3.25 

32.10 

19 

22 

4486 

4508 

1507.78 

15839.62 

17347.40 

68.53 

3.63 

19.41 

20 

23 

4481 


2298.73 

17280.08 

19578.81 

99.94 

3.85 

25.95 

21 

22 

3760 

3782 

1082.97 

14119.92 

15202.89 

49.23 

3.75 

13.13 

22 

23 

3575 

3598 

1588.98 

15140.64 

16729.62 

69.08 

4.23 

10.33 

23 

22 


3072 

1627.85 

13056.20 

14084.05 

73.99 

4.28 

17.28 

21 _25 

23 

3588 

3011 

1467.56 

16080.22 

17547.78 

63.80 

4.48 

14.24 

20_ 30 

23 

4026 

4049 

2379.74 

18148.03 

20527.77 

103.46 

4.50 


31 — 35 

22 

2622 

2044 

1227.39 

12316.80 

13544.19 

55.79 

4.09 

1 1 .ou 


23 38447 38470 15745.49 153912.30 169657.79 084.59 4.00 171.16 
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TABLE 7. ANALYSIS OF VARIANCE OF STATURE BETWEEN AND WITH IN DISTRICTS 


community 


d.f. 



a.s. 


m.M. 

ratio 

H/W 

B 

W 

T 

B 

w 

T 

B 

W 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(?) 

(8) 

(0) 

(10) 

Dogro 

20 

7061 

7081 

650.57 

25803.98 

20414.55 

27.53 

3.00 

7.52 

Punjabi 

21 

7815 

7836 

784.82 

31549.47 

32334.29 

37.37 

4.04 

9.25 

Sikh (scheduled castes) 20 

5500 

5526 

106.42 

20308.16 

20414.58 

5.32 

3.09 

1 .44 

Sikh (others) 

21 

10138 

10159 

249.64 

40805.50 

41055.14 

11.89 


2.90 

Jat 

17 

4081 

4101 

341.11 

14056.40 

14397.57 

20.00 

3.44 

5.83 

Rajput 

21 

801 

822 

447.23 

2976.60 

3423.83 

21 .30 

3.72 

A. 73 

Ahir 

10 

2026 

2042 

246.00 

8924.04 

9170.01 

15.41 

3.40 

4.53 

Oujar 

11 

203 

214 

30.13 

585.02 

015.15 

2.74 

2.88 

0.05 

total 

iCl 

38447 

38470 

15745.49 

153912.30 

169057.79 

084.59 

4.00 

171.15 


It can be seen that in all age groups the variance ratio is much greater than 
required for significance at 1% level. Within individual communities the differences 
between districts are smaller. For Sikh (scheduled castes) and Gujars the differences 
between districts are not significant. 

Incidentally in column (9) of Tables 4 and 0 we notice a remarkable trend of 
the' within variance.* It appears that differences in height among individuals become 
more and more pronounced as age advances! One is tempted to look for some hidden 
law of nature behind this phenomenon, but the safe thing will perhaps be to attribute 
this to relaxation of standards of height in the higher age groups in which the recruits 
mostly belong to certain technical trades. 

The mean values of stature for individual districts are given in Table 8. 


TABLE 8. MEAN VALUES OF STATURE IN- 
DISTRICTS OF PUNJAB 


district 

N 

moon 

Kungra 

Simla 

Hoshiarpur 

Hhatinda 

5723 

235 

3665 

198 

65.10 

65.19 

66.36 

06.38 

Ambala 

Karnal 

Gurdaspur 

Jullundur 

2190 

940 

2112 

2854 

66.39 

06.48 

66.51 

66.52 

Ferozopur 

Kapurthala 

Ludhiana 

Amritsar 

3110 

304 

3549 

3516 

66.57 

66.62 

66.67 

66.68 

Patiala 

Sangrur 

Rohtak 

Gurgaon 

979 

372 

43)0 

1783 

66.69 

67.03 

67.06 

67.08 

Hissar . 

Mahcndrngarh 

unspocifiod 

1362 

1078 

125 

67.11 
67.65 
67.30. . 

total 

38471 

66.46 
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The lowest average of stature are in the hill districts of Kangra and Simla. 
In the other districts the average height ranges from 66'.36 to 67'.55. 


Years of recruitment 

We now pass on to a consideration of differences in stature among different 
years of recruitment. It was to find out whether there is any progressive secular 
trend that this study was initiated. The nearest we can get to a study of this trend 
seems to be through a comparison of the mean values for different years of recruit¬ 
ment. Table 9 gives the results of analysis of variance. 


TABLE 9. ANALYSIS OF VARIANCE OF STATURE BETWEEN AND WITHIN YEARS OF 

RECRUITMENT 


linn 


d.f. 



•.«. 


m.». 


ratio 

B/W 


B 

W 

T 

B 

W 

d| 

B 

W 

(1) 

(2) 

(3) 

(4) 

(6) 

(6) 

(7) 

(8) 

(9) 

(10) 

17 

7 

3236 

3243 

134.77 

12966.26 

13101.03 

10.25 

4.00 

4.81 

18 

7 

5443 

5450 

189.03 

19776.10 

19965.82 

27.09 

3.03 

7.40 

10 

7 

4501 

4508 

90.85 

17247.56 

17347.40 

14.26 

3.83 

3.72 

20 

7 

4497 

4504 

174.57 

19404.24 

19578.81 

24.03 

4.31 

5.78 

21 

7 

3776 

3782 

103.48 

15009.41 

15202.89 

27.04 

3.97 

6.00 

22 

7 

3501 

3598 

172.69 

16556.92 

16729.61 

24.67 

4.01 

5.36 

23 

7 

3065 

3072 

219.37 

14464.08 

14684.05 

31.33 

4.71 

0.05 

24 — 25 

7 

3604 

3611 

181.72 

17366.06 

17547.78 

25.90 

4.81 

6.39 

20 — 30 

7 

4042 

4049 

176.82 

20350.96 

20527.78 

25.26 

5.03 

6.02 

31 — 35 

7 

2637 

2644 

101.60 

13442.60 

13544.20 

14.61 

5.09 

2.85 

total 

7 

38463 

38470 

1091.51 

168566.28 

169657.79 

155.93 

4.38 

36.60 


The variance between years of recruitment is highly significant for all age 
groups. The mean values of stature in each year of recruitment for each age group 
is given in Table 10. 
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TABLE 10. MEAN STATURE IN EACH AGE GROUP FOR DIFFERENT 
YEARS OF RECRUITMENT 






yoar of rocruitmont 




lotal 

ago — 

1948 

1949 

1950 

1951 

1952 

1053 

1054 

1955 


(1) 

(2) 

(3) 

(4) 

(6) 

(6) 

(7) 

(8) 

(0) 

(10) 




number in 

sample 





17 

429 

24 

461 

378 

472 

512 

400 

508 

3244 

IS 

429 

1819 

533 

534 

553 

509 

550 

401 

5451 

19 

433 

1012 

528 

516 

523 

564 

402 

471 

4509 

20 

400 

1193 

490 

474 

489 

543 

450 

400 

4505 

21 

417 

605 

527 

446 

459 

493 

431 

405 

3783 

22 

387 

694 

506 

452 

429 

425 

380 

326 

3599 

23 

389 

544 

510 

405 

321 

371 

300 

221 

7330 

24 — 25 

401 

980 

507 

401 

377 

303 

319 

204 

3012 

26 — 30 

370 

1378 

571 

461 

416 

278 

327 

241 

4050 

31 — 30 

364 

520 

427 

502 

168 

148 

285 

231 

2045 

total 

4025 

8709 

5066 

4632 

4206 

4200 

3076 

3591 

38471 





moan values 





17 

60.12 

65 04 

66.00 

00.18 

60.22 

60.42 

05.80 

00.60 

00.20 

IS 

00.57 

06.29 

66.55 

66.43 

60.65 

00.84 

00.70 

00.45 

00.60 

19 

60.59 

00.55 

66.79 

06.47 

66.83 

M Hit 

00.05 

60.84 

00.09 

20 

00.53 

06.56 

60.06 

66.31 

66.82 

00.99 

06.01 

00.89 

00.00 

21 

00 GO 

66.40 

66 92 

66.31 

60.84 

00.93 

00.50 

00.00 

00.05 

22 

00.30 

06.31 

66.76 

66 26 

60.55 

00.71 

66.01 

60.93 

00.63 

23 

00 43 

06.28 

66 64 

65.87 

00.00 

06.05 

60.53 

00.75 

00.45 

21 — 25 

00.27 

60.03 

60.55 

65.82 

00.24 

60.08 

00.32 

00.43 

00.19 

20 — 30 

60.24 

00.19 

06 21 

05.83 

60.20 

00.30 

00.06 

00.85 

00.20 

31—35 

60.47 

60.28 

06 16 

65 99 

66 35 

00.27 

00.40 

06.05 

00.29 

total 

66.42 

66.32 

60 55 

66.16 

66.57 

60 09 

60.46 

00.60 

00.40 


Table 10 as it stands is not very revealing. Our primary interest is to find 
out whether any trend exists in the rows of mean values. Linear regression equations 
have been fitted and the variance attributable to 1 d.f. associated with these regres¬ 
sions have been calculated. These together with the relevant error mean squares are 
given in Table II. 


TABLE II. LINEAR REPRESSION OF STA TURE ON YEARS OF RECRUITMENT 

degrees of froedom 


moon squares 


38463 


323.82 


4.38 


73.93 



linear 

regression 

orror 

linoar 

regression 

error 

ratio 

oooffleiont of 
regression 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

17 

18 

19 

20 

21 

1 

1 

1 

1 

1 

3236 

5443 

4601 

4497 

3775 

16.72 

64.34 

34.45 

59.93 

9.11 

4.00 

3.63 

3.83 

4.31 

3.97 

4.18 

17.72 

8.99 

13.90 

2.29 

0.0314 

0.0475 

0.0387 

0.0500 

0.0218 

22 

23 

24—25 

26—30 

31 — 35 

InAel 

1 

I 

1 

1 

1 

3591 

3066 

3604 

4042 

2637 

74.44 

29.74 

0.74 

14.71 

9.15 

4.61 

4.71 

4.81 

6.03 

6.09 

16.15 

6.31 

1 .40 
2.93 
1.80 

0.0647 

0.0446 

0.0192 

0.0269 

0.0258 


0.0406 


The ratios of mean squares given in column (6) show that the linear regression 
is significant at the 0.1% level in three of the groups as well as in aU the age groups 
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put together. The regression is insignificant only in higher age groups in which 
the records of stature must be very much heterogeneous. 

Chart 3 shows the overall means for the different years of recruitment together 
with a straight line representing the trend. The increase is 0'.04 per year or about 
1 in 2;> years. A rate of increase of this order of magnitude could not have been 
detected without using the large numbers of measurements we arc dealing with in 
the present study. 


67.0 J 



1W8 1049 19to ivi.1 iek2 19 & u'm lass 


Chart 3. Mean height of recruits of different years from Punjab. 

There is little scientific data about the height of Indians in the past. The 
scientists who investigated the human remains at Rupkund in the Himalayan border 
of U.P. were reported (The Statesman, 1960) to have come to the conclusion that the 
remains were probably those of inhabitants of the Punjab some 600 years ago and 
that the average stature of males was about 66$ inches. As it happens that the 
average stature of our sample from Punjab is 66.46 inches it appears that human 
stature has increased little since that day. Of course this does not rule out the possi¬ 
bility of several ups and downs having taken place during this long period of years. 

In the anthropometric data published by Risley (1891) there arc records 
of stature of 152 men from Punjab. The average of these 452 values is 66". 24. Even 
though this average relating to the period 1886-88 is lower than the average of 66". 46 
in the present study, the difference is not statistically significant. 

Analysis of variance between years of recruitment has been carried out also 
for the major communities. The results are given in Table 12 from which it can 
be seen that the differences among years of recruitment arc significant even in individual 
communities. 

TABLE 12. ANALYSIS OF VARIANCE BETWEEN AND WITHIN YEARS OF 


RECRUITMENT SEPARATELY FOR COMMUNITIES 




d.f. 



S.R. 


m.8. 

ratio 

B/W 

community - 

B 

W 

T 

B 

w 

T 

B 

W 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

(0) 

(10) 


7 

7074 

7081 

630.70 

25783.81 

26414.51 

90.10 

3.04 

24.75 

Dogra 

7 

7829 

7836 

195.82 

32138.46 

32334.28 

27.97 


0.81 

Punjabi 

Sikh (scheduled castes) 

0 

5520 

6526 

421.22 

19993.30 

20414.58 

70.20 

3.62 

19.39 


n 

10152 

10159 

651.70 

40403.44 

41055.14 


3.98 

23.30 

Sikh (othors) 

i 

7 

4094 

4101 

109.05 

14288-53 

14397.58 

15.68 

3.49 

4.40 

Jat 

n 

815 

822 

118.09 

3305.74 

3423.83 

16.87 

4.06 

4.10 

Rajput 

Al.ir 

i 

7 

2635 

2642 

99.37 

9071.27 

9170.64 

14.20 

3.44 

4.13 

ml nl 

7 

38463 

38470 

1091.51 

168566.28 

169657.79 

155.93 

4.38 

36-00 
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That there is significant variation between age groups in some of the other 
states of India can be seen from Table 13. 

TABLE 13. ANALYSIS OF VARIANCE OF BETWEEN AND WITHIN 
YEARS OF RECRUITMENT 


community 


d.f. 



M. 


m.». 


H/W 

B 

W 

T 

B 

w 

T 

B 

W 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

<7) 

(8) 

(9) 

(10) 

Bihar 

7 

9701 

9798 

1003 

43181 

44184 

143.34 

4.41 

32.50 

Bombay 

7 

13147 

13154 

1096 

47464 

48560 

156.53 

3.01 

43.30 

Jammu and Kashmir 

7 

3076 

5683 

61 

22283 

22344 

8.00 

3.93 

2.21 

Koralu 

7 

II126 

II133 

839 

37781 

38620 

1 10.85 

3.40 

35.25 

Mu drag 

7 

II160 

II173 

506 

38266 

38772 

72.20 

3.43 

21.07 

Punjab 

7 

38463 

38470 

1092 

168560 

169658 

155.03 

4.38 

35.00 

Kujantlmn 

7 

6782 

0789 

638 

24979 

25017 

91.00 

3.08 

24.75 

U.P. 

7 

28300 

28307 

819 

124003 

124822 

110.93 

4.38 

20.70 

Wost Hongnl 

7 

3343 

5350 

631 

21508 

22139 

90.12 

4.02 

22.42 


Data from other countries 

Morant (1939) is one of the writers who have assembled evidence on the 
increase of human stature. In Chapter V of his book on "The Races of Central 
Europe" Morant states: "For several European countries and for Japan there is good 
evidence to show that the average height of adults has been increasing steadily since 
about 1800. Data for some of the countries of Central Europe show the same tendency, 
and it has probably been general throughout the continent. English records have 
established the fact that in recent times sons are taller than their fathers, on the 
average. The secular rate of increase seems to have been fairly uniform in the different 
countr.es for which good statistics are available, and it is nearly one cm in ten years 
or nearly one inch in twenty-five years.” 


The conclusion regarding sons being taller than their fathers in England 
refem only to the stature at adolescent stage before the full height is attained. From 

ad,r, q H ry ,n :r ,ng C ?7 nri30DS ° f reC ° rdS ° f he * ht British adolescents and 
adults during the period from 1845-1948 covering in all more than two million men 

lie numbers being largest for the ages 18-25, mostly candidates for recruitment into 
he m“ y ' ' lf° concludes that "The best estimate that can be given for 

the maximum mean he.ght of the general population of British men is 67' 6 and 
this appears to have romamed unchanged in the past 100 years. There are clear 
differences between the values for different classes of the community and these ilso 
appear to have remained unchanged_ The conclusions nrr tw « 

is the same as their ancestors who matured more slowly." 8 
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Karpinos (1961) in a study of some 273,000 candidates for recruitment 
(including those disqualified as well as those inducted) into the United States army 
during the period January 1957 through September 1958 has concluded that: “The 
recruit of today is on an average 0.5 inch taller than the recruit of World War II 
and about 1.2 inches taller than the recruit of World War I.” In reaching these 
conclusions Karpinos has taken care of differences in age distributions of the popula¬ 
tions compared by means of a technique of ‘standardisation* of age. In a note 
published by the Metropolitan Life Insurance Company in their Statistical Bulletin, 
(1944) it is stated that “stature shows distinct signs of increase in the present 
generation. The average height of men in the ages 20 to 29 examined at induction 
stations for the armed service in May 1943 was 68.15 inches (without shoes). This 
figure is about two-thirds of an inch more than the average of 67.49 inches for the 
first million draftees of ages 21 to 30 examined at mobilization camps in the last 
World War in 1917. The figure cited for 1943 is based upon an analysis of data 
recently published by the office of the Surgeon General of the Army.” The rate of 
increase in stature of American recruits is thus quite comparable to what was noticed 
in Europe by Morant during the middle of the last century and what was indicated 
for Indian recruits in the present study. 

A comparison of the average stature of insurance policy holders in America 
(Society of Actuaries, 1959) during the periods 1885-1908 and 1935-54 is given in 
Table 14. 


TABLE 14. AVEKAOE STATURE OF INSURANCE 
POLICY HOLDERS IN AMERICA 


“go 

avorago ntuturo in 
inchos of Don 

nunibor of 
policio* 
in column 3 

1835-1908 

1935-1054 

(1) 

(2) 

(3) 

(4) 

1C— 16 

66.6 

67.4 

6600 

17— 19 

67.6 

69.4 

13043 

20 — 24 

68.4 1 

69.6 

92476 

25 — 29 

68.6J 



30 — 34 

68.41 

69.2 

96065 

36 — 39 

68.6 J 



40 — 44 

es.s. 

68.6 

69827 

45 — 49 

68.6] 



60 — 64 

68.51 

68.2 

19671 

65 — 69 

68.4] 



60 — 64 

68.41 

68.1 

2192 

65 — 69 

68.5] 




It can be seen that during the fifty year* separating the two periods compared 
. Tahle l'l the age group 15-16 increased in stature by 1.8 incl.es. the age group 
,7-10 l,v 1 0 inches the age group 20-29 by 1 1 inches, the age group 30-39 by 
0.7 inches and the age group 40-49 by 0.1 inches. In the higher age groups there 
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has been a small decrease in stature. The numbers of cases on which the averages 
in column (2) are based were not available in the publication. The general conclusion 
seems to be that during the present century average stature has been increasing 
at about the same rate as observed in Europe fifty years earlier. 

Data given in the Pocket Year Book 1901 (Table 32, page 18) published by 
the Netherlands Central Bureau of Statistics relating to the Dutch army is reproduced 
in Table 15. 


TABLE 15. AVERAGE STATURE OF CONSCRIPTS 
IN THE DUTCH ARMY 


yoar 

number of 
conscripts 

ovorugo ataturo 
in ems 

(1) 

(2) 

(3) 

1900 

38.669 

109 

1920 

*4.214 

170 

19*0 

82,994 

173 

I960 

81.790 

I7G 

1961 

77,050 

170 


The averuge age of conscripts as stated in the Pocket Book is 18.5 years. 
It appears that there has beon an increase of 7 ems in average stature during the 
first sixty years of this century. Of this 0 ems were gained during the forty 
years from 1920 to I960. This is a higher rate of increase than noticed elsewhere. 

Schreider (I960) in Chapter 13 Table 6 of his book La Biometric gives 
comparative data about gain in stature in a number of countries. This is 
reproduced in Table 10. 


TABLE 16. INCREASE IN HEIGHT 


country 

period 

duration 

initial and 
final height 

gain total 

gain per 

(1) 

(2) 

(3) 

in ems 

(41 


decado 

Poland 

Japan 

Nethorlnnd.H 

1881 — 1894 
1897— 1917 
1865— 1923 

13 

20 

58 

164.8- 105.6 

156.3- 156.9 
16*.1 - 170.8 

165.4- 169.5 

«>) 

0.8 

1 .0 

0.7 

.t 1 

( 0 ) 

0.0 

0.8 

l.l 

Danmark 

1854 — 1925 

71 

Franco 

Swodcn 

Italy 

Franco 

Norway 

1790— 1870 
1840— 1920 

80 

80 

155.5- 165.0 
165.4 - 173.0 

0.5 

7.6 

0.0 

1.2 

0 9 

1791 — 1910 
1801 — 1953 
1741 — 1939 

125 

153 

195 

161.7-169.7 
169.2- 174.5 
168.5- 173.7 

8.0 

5.3 

5.2 

0.0 

0.4 

0.3 


T U DU . ring . th0 short time that 1 had ««*** to Schreider's book written in French V 
could not make out the source of the date or tl.c number of observations that have' 
gone mto the averages. The two sets of figures for France which are not quite^ 
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agreement with each other must have come from different sources. The increase 
recorded for Japan tallies well with the rates noticed elsewhere and if we take a simple 
average of the rates of increase for other countries it works out to somewhat lower 
than the rate of one inch in 25 to 30 years. 
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1 

In social research, we are concerned basically with one or more courses of 
behaviour of o people in the aspects of their social and/or economic organization, 
cultural and/or ritual characteristics, etc. We wish to know what are these courses 
of behaviour, how arc they integrated in different dimensions of the life and living 
of a people, and why are they pursued in a society. Because from the knowledge 
we thus gain successively on many courses of behaviour, wo may ascertain eventually 
the specific type of social organization the people represent, the particular form of 
social change they are passing through, and so on. 

Accordingly, we have to take into account a set of characters to denote a 
particular course of behaviour of the people vis-a-vis themselves or other fellow beings, 
goods or services. For any course of behaviour can be ascertained only from the 
ensemble of net effects produced by the multitude of its expressive characters. 

The selection of these characters in terms of their intrinsic merit to the study 
as well as their relative importance in that respect becomes, therefore, an important 
analytical problem we face at the outset. 

To illustrate, from an examination of all the 1279 households comprising 
seven randomly selected villages within the region demarcated by the maximum 
walking distance of five mile? from the town of Cliridih in Bihar, an attempt was made 
to show “variations in the levels of living in rural areas" (Chattopadhyay and Bandyo- 
padhya v, 1903). The study is of some significance to our understanding of t he dynamics 
of rural society because the position one holds currently in Indian villages is acknow¬ 
ledged to depend, to a large measure, on his or her standard of living. Further, 
such a characteristic of Indian rural life is not without its historical antecedent. For 
example, in ancient treatise like Kautilya's Arlhasastra prosperous villagers (suUia- 
vastha) were mentioned as having specific privileges and obligations in respect of 
the life and living of co-villagers (Shamasastry, 1051, 178 etc.). Therefore, an exami¬ 
nation of variations in the levels of living in Indian villages would be of sociological 
interest both for the traditional and the current course of behaviour in rural society, 
besides its obvious economic connotation. 

But the question is whether the course of behaviour can bo validly (need 
not bo, fully) represented by the five characters taken into account for the aforesaid 
study. Namely, the per capita stock position in rupees of the househo'ds in respect of 
(a) roofing materials, ( b) clothing, (c) domestic utensils, (d) silk and woollen goods 
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forming a part of clothing materials as not absolutely essential items, and (e) domestic 
utensils made of metals like aluminium, brass, etc., as part of all domestic utensils 
and with the same connotation as for the character (d). Further, whether the five 
characters can impart successively precise knowledge on this course of behaviour 
irrespective of the fact that additional characters may he useful in that respect. 

We may agree that the per capita stock position, instead of the expenditure 
pattern, is the more suitable indicator of the levels of living of the households. Because 
it is not what a household ,s pends within a reference period (be it a month, a year, 
or a number of years) but what it possesses at a given time that denotes its position 
in society. Also, while the stock position of a household would evidently be dependent 
to an extent on the number of its constituent members, this point, was seen to by 
reducing the five attributes to per capita stocks within respective households. The 
point to discuss, therefore, would be the relevance and the relative importance of 
the five characters taken into account in order to depict the course of behaviour. 

That the first three characters (n). ( b ) and (e) are indispensable to the life 
and living of any social being needs hardly any comment. People, wherever they 
may live and whatsoever may be their condition in life, must have a roof on their 
head, some clothes to wear, and some utensils to cook their food and eat. Hence, 
in their qualitative evaluation, these three characters may be considered to represent 
the wolf line in society, just as Davis coined the label wolf point to denote the sub¬ 
sistence income. For: “Below this point the wolf, which lurks so close to the doors 
of those in the neighbourhood of the modal income, actually enters the house” (Davis, 
1941, p. 27). It would, consequently, be pertinent to ask: Are there possibilities, even 
within the wolf line, of improving the standard of living in terms of the characters 

(d) and (e), for instance? 

Because, irrespective of the fact that a consideration of additional characters 
might have presented the course of behaviour more comprehensively, only an affir 
mativc answer to the above query would substantiate the relevance and specific 
utility of taking into account the five characters for the present study. Therefore, 
with reference to this specific situation, the analytical problem may be formulated 
as follows: Whether the respective characters, and pointedly the characters (d) and/or 

(e) as successive to the characters (a + b+c), have specifically critical importance to 
the course of behaviour in terms of the net effect they produce in group-differentiation 
among the categories of classification brought under examination. 

II 


We notice from the above that a classificatory problem is intrinsically associa¬ 
ted with the analytical problem in view. Namely, since it is with “social” behaviour 
that we are concerned, our task is to ascertain the societal groups in which the specific 
wavs of expression of the course of behaviour (as represented by the chosen charac¬ 
ters) arc repetitive for the respective groups and are distinctly non-repetitive between 
Hu tu Apropos we have to consider such already ascertained groupings of the people 
„s refer to their'other courses of behaviour exacted or known to have a significant 
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bearing on the one under reference. For the identification of "groups” in the present 
context would not otherwise be a structural and functional reality for the given 
society. 

But the process of classification requires thereby an important task to be 
accomplished; the task having three phases in its operation. Namely: (a) the appro¬ 
priate constitution of societal groups, (b) out of the total number of classilicatorv 
units referring to each known course of behaviour brought under consideration, 
(c) in terms of the relevance of these units to the course of behaviour under reference 
and their relative importance in that context. For, on the one hand, to take into 
account individually all possible units of classification vis-a-vis a known course of 
behaviour is hardly ever a practical proposition; and. on the other, these units may 
not (or need not) be identically distinguished from one another for the course of 
behaviour examined as they were for the one producing them. 

Consequently, the most effective and the most precise categorization of each 
set of societal units brought under consideration vis-a-vis the course of behaviour 
under reference becomes another important problem to bo solved. 

This problem, again, may be illustrated from the study of Clmttopadhyny 
and Bandyopadhvay (1903). Because the study was based on the hypothesis that the 
variations to be investigated are reflected in two ways: One. by the “economic” 
affiliation of the heads of households to respective sectors of the national economy 
(industry), the types of job (occupation) they perform within a given "industry", 
and the relations of production they represent thereby as employer, employee or 
own-account worker (activity status); and, two. by the "social" affiliation of the 
households to various religious communities and. furthermore, to respective castes/ 
sects within a given religious community. 

Other already ascertained groupings of the same people could be brought 
to account. But that point does not concern us here. What, on the other hand, 
we. must note contextually is that it would have been impossible to bring into account 
individually all the units of the above two sets of classification. 


Thus, to consider first the religion-caste/scct-wise classification of the people 
.t is known that their ritual and "social" behaviour, etc., as expressed through the 
institution of inamagc. authoritarian control over them, and so on. refer uniquely 
to each caste or sect as well as to each cashless community. That way, therefore 
each one of them represents a unit of classification. But when making use of the 
rebg.on-caste/sect affiliation of the people for purposes of classifying them into mutually 
distinct societal groups, we can hardly take into account nil the castes and sects and 
ah the casteless communities, respectively. For while dealing with only seven villages 
nd a total of 1279 co resident and commensal units (households), the aforesaid studv 

Ir.lLTl T 'a 80 . diStinCt Cast * /sect or castelcsa community-units, each with a 
separate label and some having even less than ten affiliated households. 

for the •v‘ h „ C T' 7 ny m0re ClaSS ' ficat0r -V units -ere to bo taken into aecount 
economic classification of the households even though within the compass 
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of rural life the range of variation in the affiliation of the heads of households to 
different sectors of the national economy, to specific occupations within them, etc., 
was noticeably restricted. 

In such a situation, therefore, a grouping of the respective sets of classificatory 
units is essential and imperative. Accordingly, the process of classification is almost 
invariably based on a priori considerations, and the classifying categories evolved 
thereby are retained so long as the data under analysis substantiate their relevance. 
But the question remains, all the same, as to whether the adopted course of cate¬ 
gorization—found valid as above—was the most effective and the most precise in 
the circumstances. 

For example, on the basis of their personal knowledge of the 1279 households 
in the 7 villages surveyed and with reference to the models of classification available 
for the purpose, Chattopadhyay and Bandyopadhyay (1903) categorized the caste/ 
sect and casteless community-units into ft “social” groups. That is: (1) “high” caste 
Hindus—the caste-units reckoned as such by an orthodox Brahmin; (2) “middle” 
caste Hindus—the caste-units from the members of which an orthodox Brahmin will 
take water; (3) “low” caste Hindus—the caste-units from the members of which an 
orthodox Brahmin will not accept water; (4) Muslims; and (5) “tribnls”—all Snntals 
except one family of Bhumij self-declared as such. And, as would be seen from 
their paper, the validity of this course of categorization cannot be doubted. Even so, 
the following point should be given due consideration. 

Namely, if in view of large numbers of available households for respective 
caste/sect units, or on some other considerations, the units of classification (at any 
rate, a largo number of them) could be examined individually with reference to the 
net effect produced by the multitude of characters taken into account to depict the 
course of behaviour, one of the following three possible conclusions could ho drawn 
therefrom:' 

(1) The caste/sect units do not have, entirely or largely, individual relevance 
to the analysis; and so the above course of categorization remains the most effective 
(sufficient) and the most precise in the circumstances. 

(2) The caste/scct units have individual relevance to the analysis but, 
entirely or largely, it is subservient to the course of categorization m force. So that 
the above course of categorization would be found effective but not sufficient and 
not the most precise. 

(3) The caste/sect units have individual relevance, entirely or largely, and 
that way they cut across the above course of categorization. Consequently, the 
latter would be found neither sufficient nor precise, although effective in the circumst¬ 
ances as mentioned before. 


To consider next the “economic” classification of the households, they were 
classified under the four valid categories of (1) day labourers, (2) peasants, (3) technical 
hands, and (4) clerks/husinessmen, in terms of the relative power of different.at.on 
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of the three economic attributes “industry,” “occupation,” and “activity Hiatus. 
But there, again, it could bo (and should be) examined whether that course of cate¬ 
gorization has also been the most effective (sufficient) and the most precise. Or, 
whether the process of classification could be improved so as to obtain a better (the 
best possible) definition of the societal groups vis-a-vis the course of behaviour under 
reference. 

That is against the concrete situation outlined above, the cl.ossifioutory 
problem in view may be formulated as: Whether even within the wolj lino the relevant 
“economic” and “social” categories evolved on « priori considerations to classify 
the 1279 households indicate differences in the levels of living of the people. Mid 
whether either of the two independent courses of categorization is tho most effective 
and the most precise in the circumstances. 

Ill 

Successive to the analytical and the classificatory problem outlined above, 
we face a conceptual problem. For we may have been able to select, an appropriate 
panel of characters in terms of their intrinsic merit as well ns their relative importance 
to the course of behaviour under study. And we may also have been able to ascertain 
on the basis of these characters the most efficient and the most precise categorization 
of the relevant units of classification in respect of various factors like economic, ritual, 
cultural, etc., considered severally. That way, therefore, wo arc placed eventually 
with distinct sets of grouping of the corresponding classificatory units vis-a-vis the 
course, of behaviour; the sets referring to respective factors of differentiation of the 
chosen constituents of a given society. But the knowledge, thus accumulated 
successively, would not yet meet the demands of social research comprehensively. 

Because, in tho ultimate analysis, we aro concerned with the "actor” groups 
playing different “roles" with reference to a particular course of behaviour; theso 
“actor” groups being defined and distinguished from one another in the light of a 
multitude of societal factors contributing to the characterization of different facets 
of their composition. Suoh as, one “actor" group represents a particular typo of 
economic organization, a specific variety of ritual characteristics, and a distinct 
cultural make-up in contradistinction with different features of the same three facets 
of composition of another "actor” group. 

Pursuantly, we come across the problem of how can the categories of classi¬ 
fication falling under more than one set and referring thereby to respective factors 
bo integrated among the sets so as to give a conceptual appreciation of the “actor” 
groups referring to the course of behaviour. And, evidently, the problem can bo 
solved only by the most effective and the most precise categorization of the composite 
units of classification made out of the consideration of different factors simultaneously, 
and not by any formal or fortuitous combination of the respective sets of classificatory 
units. 
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Because the units of classification thus taken into account for the identi¬ 
fication of actor” groups in the context of the course of behaviour under reference 
correspond to more than one distinct course of known behaviour brought forward 
to delineate the above groups in the present context. Hence the relative distinction 
among the units of classification referring to one factor (or one cluster of factors) 
need not be the same as for the units of classification referring to another factor (or 
another cluster of factors). And so in the process of specifying the “actor” groups 
bv treating the different sets of classificatorv units simultaneously, some units referring 
to one factor may telescope into some units of another factor; while the remaining 
units of either factor may not subscribe to the above process of invagination and 
thus remain distinct as referring to the two factors compart mentally. 

1 he "actor” groups will have to be identified, therefore, from a further set 
of considerations than taken into account already with reference to the classificatory 
problem. Namely, in terms of such differentiations among the composite categories 
of classification (or, more appropriately, among the composite units o * classification) 
as would lead to the presentation of the most effectively and the most precisely 
distinguished societal groups expressing symbolically the derivatives of the multitude 
of factors taken into account. 

To illustrate, again, with reference to the previously mentioned study on 
variations in the lovels of living in rural areas, it could bo seen therefrom that both 
‘social” and "economic” factors arc contextually relevant to the identification of 
the "actor” groups. Possibly, there are other factors equally or more relevant in 
the same context. But that consideration need not detain or forbid us from noting, 
additionally, that out of the two the "social” factor is probably more important than 
the "economic” factor. Because the range of dispersion of the categories of classi¬ 
fication referring to the former was found to be larger than the outcome with reference 
to the latter, while the internal homogeneity of the categories belonging to cither 
set remained of a high order.* 

We may, of course, admit at the outset that this judgement is based on the 
gross effects produced by the five characters individually and not on their net effects 
registered by considering the characters successively and cumulatively. Even so, 
had wc granted that the "social” factor is more important than the "economic” 
factor, would that have permitted us to define the “actor” groups automatically: 
(a) in terms of the “social” factor alone, or (b) in terms of such a working of the 
“socialXeconomic” factors as would have produced the "actor” groups designated 
consistently first by their "social” and next by their “economic” appellation? Such as, 
for the first, as “Hindu ‘high’ castes,” "Hindu ‘middle’ castes,” and so on. For the 
second, as “clerks/businessmen of Hindu ‘high’ castes,” “peasants of Hindu ‘high’ 

•For wont of spaco, tho tablo relevant to this point os well os o few tobies ancillary to tho central 
theme of this popor are not included horo. Thoy refer to tho mean characteristics of tho sociotal groups 
examined in tho following tables. Tuking them into account, a paper will bo published in tho Sankhyd 
to indicate primarily tho sociological implications of tho findings from tho I>:-analysis of tho data, as pre¬ 
sented horo. —Editorial Board 
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castes,” and so on; and then as “clerks/businessmen of Hindu ‘middle’ castes, 
"peasants of Hindu ‘middle’ castes;" and so on. 

Alternatively, we may be unable to ascertain from the respective series of 
analysis the relative importance of tho factors taken into account. Or. in lieu of 
our knowledge of the net effects produced by the chosen set of characters, we may 
be unwilling to enter into the fallacy of judging that importance from the absolute 
effects produced by the characters individually. Either way, could we be satisfied 
with merely a hybrid “socio-economic” categorization of the households into 5 “social” 
X 4 "economic” = 20 mutually distinguished so-called “socio-economic'’ categories? 

For. within the constellation they form in reference of the characters examined, 
arc these 20 categories distinguished equally from one another in order to denote their 
respective "roles” in terms of the levels of living maintained in the rural society? 
Or, should these 20 categories be reduced to a smaller number by the appropriate 
pooling together of some of them severally because the respective categories within 
such a pooled one do not distinguish themselves mutually? And. thereafter, would 
the pooled categories distinguish themselves equally or in relatively different orders 
in tho light of their res|>cctive "roles” in the situation? 

Such ns, it will be seen from an appropriate analysis of the data presented 
later in this paper that as “clerks/businessmen” the Hindu 'high' caste group equates 
itself to the Hindu ' middle’ caste group, on the one hand, and the Muslim community, 
on the other; whereas the Hindu 'low' caste group as"clerks/businessmen” is sharply 
differentiated from the corresponding groups. Contrariwise, as “technical hands” 
the Hindu ‘high’ caste group is very sharply differentiated from tho Hindu •middle' 
and the Hindu ‘low* caste groups os well as the Muslim community; there being no 
distinction correspondingly between the middle' and low' Hindu caste groups and 
very little between cither of them and tho Muslim community. (Table 7). 

It will bo noticed further from the same table that tho distinctions found 
between the Hindu 'high', ‘middle’ and Mow* caste groups arc of the largest order 
as "peasants,” next as “technical hands,” then as “day labourers.” and the least ns 
"clerks/businessmen.” And similarly varying orders of differentiation (starting 
from the zero point in the scale, and in this or in the above aspect of characterization 
of the “actor” groups) may be there among all the "social” x “economic” categories 
brought under examination. 

Therefore, with reference to the composite categories of their classification 
(or, more appropriately, with reference to the composite units of their classification) 
as evolved out of the consideration of various factors taken into account, the most 
effective and the most precise characterization of tho given constituents of a society 
as “actor” groups becomes a vital conceptual problem in social research. 

Apropos, specific to the study cited as an illustration, this conceptual problem 
may be formulated as: Whether distinct “actor” groups (with their relative positions 
within the constellation they form in the society in respect of their composite categories 
or units of classification) can be identified as representing svmbiotically the “social” 
and the “economic” factor vis-a-vis the course of behaviour under examination 
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IV 

Because of t hese three problems. pointing to a critical demand in social research, 
a number of our colleagues are inclined to reject any statistical treatment of their 
observations. Some, on the other hand, may accept a course of‘‘statistical analysis” 
of their findings as only ancillary to their terms of reference; as the portal steps to 
the mansion they want to look in. And, at the most, they would concede that statistical 
analysis of their data may provide them with the outlines of the structure of the 
mansion, but with nothing beyond that. 

Therefore, whether or not they indulge occasionally in the calculation of 
averages of the variates under consideration as well as their dispersions (or undertake 
even a correlation analysis of the variates, etc.) prima facie they regard these efforts 
as merely scratching the surface of the contents of their research; as stimulating 
exercises providing a piece-meal and uncoordinated (and, therefore, by itself a mecha¬ 
nistic and unreal) pre-view of their actual task. In large numbers, consequently, 
sociologists are prone to appreciate their findings on the basis of a directly integral 
understanding of the situation as a u-liote in conformity with their specialized training 
to observe, deduce and infer accordingly; and without depending (on essential counts) 
on any statistical treatment of their “data.” 

To he sure, such a method has its own usefulness, up to a point (Mukherjee, 
190(>). But the fact remains, all the same, that even if such an approach be crystal¬ 
lized into what is commonly (and often erroneously) labelled as the “ holistic” view 
point, the approach must take into account (implicitly, at any rate): 

(1) A set of characters considered relevant and important by the researcher 
to represent the course of behaviour under reference. 

(2) The units of classification referring to known courses of allied behaviour. 

(3) The categories of classification to be evolved by subjective cogitation 
or objectively (in one way or another) out of each set of classificatorv units referring 
to a distinct factor. 

(•1) The relative power of discrimination of these factors for the character¬ 
ization of the “actor" groups out of a com|»osite consideration of all sets of units and 
categories of classification. 

Therefore, we may he able to persuade many of our colleagues to veer round 
to an objective assessment of their “data” without the anxiety of sustaining any 
loss to their intrinsic value in the process, provided we can demonstrate that a parti¬ 
cular statistical tool would meet the following requirements. Namely: 

(1) Any out- set of characters can be treated cumulatively in terms of the 
vet effects produced by them, respectively, on a correspondingly chosen set of units 
of classification referring to a single factor (or on any composite set of units referring 
to a multitude of factors). 

(2) The course of analysis would thus promote the desired process of classi¬ 
fication of the units (determined with reference to one factor or a multitude of factors) 
into the most efficiently ami the most precisely distinguished categories. 
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(3) The process of classification would, therefore, load to the identification 
of “actor” groups out of the given constituents of the society under examination m 
terms of a symbiotic representation of the multitude of factors. 

This statistical tool that we may choose to serve the purpose is commonly 
known as Mahalanobis's D* because (a) its designer is Professor P. C. Mahalanobis 
and (b) its basic concept is of the “Generalised Distance (/>*) introduced ... I0i» for 
purposes of classification of a number of groups, on the basis of then mean positions 
in a -dimensional character-space” (Mahalanobis. 1990, iv). In the following, there¬ 
fore, we shall try to demonstrate its usefulness with reference to the previously 
mentioned study by Chattopadhyay and Bandyopadhyay since in that context wo 
have illustrated the three basic problems of social research labelled as analytical, 
classifies torv and concept ual. 

To the sociologists with a statistical training, a review of the IP-statistic 
would be redundant. At any rate, they would get a better account of its properties 
from the relevant writings of Mahalanobis himself and of his statistician colleagues 
(Bose. 1939; Bose and Roy. 1938; Fisher. 1939; Mahalanobis. 102a. I92H. 1930. 1930. 
1949; Rao. 1919. 1932, 1955. 1900; etc.). To the remaining sociologists, on the other 
hand, a detailed account in this respect may be too technical and tedious. Therefore, 
without going into such technicalities (including an account on the applicability 
of the tool to the data under reference, for which our bonafidea may be granted), 
we may enumerate here only the following specific usefulness of the Z)*-atatistic in 
the present context: 

(1) In terms of the net effects of the characters brought to account succes¬ 
sively, D 1 -values can be calculated to measure the distance between any two units 
or categories of classification of the constituents under analysis in a given society. 
These values may then be examined ns statistically significant or not against the 
null hypothesis that the true distance between any two units or categories is zero. 
For this purpose, the one per cent level of significance may be regarded as a very 
critical level because it would greatly reduce (and virtually eliminate) the risk of 
rejecting the null hypothesis of wo distance between two categories or units while 
in fact there is no distance between them. 

(2) Apropos, if the Devalue between any two units or categories of classi¬ 
fication is found to be not significant, it would imply that either the two units or the 
two categories truly equate with each other in the universe (in reference of the characters 
taken into account to discriminate them) or their sample sizes are so small that 
they are unable to elicit and measure the distance between the two units or categories. 
Hence, provided the sample sizes of the units or categories of classification are at 
least appreciably large (if not distinctly large), we may ignore the second contingency 
and conclude with a fair degree of certainty that vis-a-vis the course of behaviour 
(and with reference to its representation by the chosen set of expressive characters) 
these two units or categories of classification may be pooled together in order to form 
a homogeneous group of the constituents falling under both of them. 
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(3) Alternatively, if the Z) 2 -vaIue between any two units or categories of 
classification is found to be statistically significant, that value (however small or 
big it may be. and irrespective of the sample size of the units or categories) may be 
employed to measure the distance between the two groups of constituents falling 
under respective units or categories. So that, by considering -the Devalues to 
represent the zero-distance in the scale when they are not found to be statistically 
significant, a set of units or categories of classification—(composite or not, as referring 
to one or more factors)—may form a group constellation in reference of the Generalised 
Distances they record mutually. 

(4) The group constellation may be presented diagrammaticallv or by an 
appropriately partitioned contingency table, as constructed for the present paper. 
Either way. in the light of such group constellations: (a) the relevance ard the relative 
importance of the characters used for analysis may be ascertained to solve the analytical 
problem discussed first; (b) the course of categorization of the constituents under 
analysis in a given society may be made the most effective and the most precise in 
the circumstances in order to solve the classificatory problem discussed next; and 
(c) the "actor” groups may be identified objectively in reference of the composite units 
or categories of classification brought forward for the simultaneous consideration of 
nil the chosen factors in order to solve the conceptual problem discussed last. 

Thus in answer to the first problem we find from Tables 1-4 that as successive 
to the characters (u-ffc-f-c) the characters (d) and (e) have specifically critical import¬ 
ance to the course of behaviour examined. Such as: it is not only the consideration 
of the five characters as (a 4-6+c+d-f e) that registers the longest distances among 
the relevant categories of classification and the three basic characters ns («+6-l-c) 
record the shortest distances correspondingly (Tables 1-2), but even within the wolf 
line the character (d) tends to increase the distances among the categories of the 
"social” classification more than the character (c) and the converse tends to be the 
role of the two characters for the ‘'economic" classification (Tables 3-4). 

Similar effectiveness of the two characters (d) and (c), respectively, was noticed 
in reference of the data contained in Table.* 5-8. This, however, need not bo discussed 
by incorporating 12 additional tables because the Tables 1-4 may be regarded to 
give ample indication of how the first problem described in this paper can be solved 
satisfactorily by the application of the D*-statistic to the relevant data. 

As to the second problem, we find that the categories considered in Tables 1 
and 2 in reference of the "social” and the "economic” factor are, no doubt, valid 
in as much as the respective categories within either set are at a significant distance 
from one another. But if we attempt a course of categorization of the units of 
classification of either set on the basis of the cumulative net effects of the five 
characters, we come across more efficiently and more precisely distinguished categories 
cutting across those decided on a priori considerations for the above two tables 
(Tables 5 and 6). 

To be sure, if the sample sizes of the respective units of classification were 
all distinctly large (and also if all the recorded units of classification could thus bo 
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taken into account), the most effective and the most precise form of categorization 
could have been achieved in reference of the “social” and the “economic” factor. 
But, failing that, even in the present circumstances the intrinsic usefulness of tho 
courses of categorization obtained from Tables 5 and C would be obvious ton sociologist 
by comparing the clusters of units pooled therefrom with those adopted, respectively, 
for the Tables 1 and 2. 

However, in order to emphasize the usefulness of the application of the 
Z)*-statistic to solve the previously discussed classificatory problem, we may note 
some of the salient features of the alternate courses of analysis given in Tables 5 and 0 
as against those in Tables 1 and 2. and of those in Tables 1 and 2 as against those in 
the two tables of the paper bv Chattopadhvay and Bandyopadhyay (1963). Such as: 

(1) The distance between the “middle" and the “low" caste Hindus is much 
less than that between the "high" caste Hindus and the rest of the Hindu community, 
while the Muslim community occupies a position in between the “high" and the 
“middlo” caste Hindus in this course of categorization (Table 1). 

(2) The Muslim community also should be examined, in the present context, 
in the same way as tho stratified Hindu community, and not cn bloc, and. as 
found for the arrangement of the Hindu caste-units, the Muslim sect-units arrange 
themselves in a way peculiar to the course of behaviour under reference by forming 
clusters among themselves as well as by telescoping into tho caste-clusters of the 
Hindus (Table 5). 

(3) To consider the peasants and the agricultural labourers alike as pertain¬ 
ing to the agrarian economy is unreal for the present study, just as it would havo 
been if all kinds of daily wage-earners were pooled together to form a classifying 
category (Tables 2 and 6). 

(4) Although referring to “technical hands" either way. the milieu of the 
mica-processing industry and that of coal-mining have distinct roles to play vis-a-vis 
the course of behaviour under reference; whereas, for the workers in coal mines, it 
is the total milieu which is of overriding importance to their distinction as miners 
or surface-hands (Table 6) and so on. 

Lastly, in reference of tho third problem discussed in this paj>or. it has already 
boon noted how the “actor" groups can be identified by examining the Generalised 
Distances among the combined categories of “social" and “economic" classifications 
(Table 7). Evidently, if all the combined “social" and “economic" units could be 
brought into account for the purpose, the most efficient and the most precise categories 
in this respect could have been ascertained. And that would have led to the clearest 
identification of the “actor” groups vis-a-vis the course of behaviour under investiga¬ 
tion. But because some of these units are represented by too few households, this 
cannot be demonstrated in this paper. Even so, it is seen from a consideration of 
only those combined units which are represented by more than 10 households os 
how useful the Z>*-statistic can be to identify the “actor” groups (Table 8) 
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Tho intrinsic merit of the findings in the above tables would be directly appre¬ 
ciated by a sociologist, and hence that need not be discussed here. Instead, in keeping 
with the central objective of this paper we may now claim to have demonstrated 
the usefulness of the D s -statistic to social research in particular reference to the three 
problems enunciated and illustrated on the basis of aspecific course of social behaviour. 


V 

Of course, a study in variations in the levels of living in a society need not be 
regarded as of prime importance to social research. Nonetheless, the above discussion 
may persuade social scientists in India or elsewhere to apply the D*-statistic for the 
solution of the three enumerated problems in reference of such courses of social beha¬ 
viour as would deserve priority. Besides, there are other problems and issues in social 
research for which also the application of the D*-statistic would be pertinent 
or essential. 

Such as. given the label social mobilization “to an overall process of change, 
which happens to substantial parts of the population in countries which are moving 
from traditional to modern ways of life*’ (Deutsch, 1901, 493). the D’-statistic may bo 
a very useful tool to unravel this issue in a society. Namely : (a) to assess the “process 
of change by a chosen list of quantitative parameters as put forward by Professor 
Deutsch. for instance, in his above-mentioned study {vide, the analytical problem) ; 
(b) to categorize precisely the "substantial parts of the population” in the aforesaid 
context {vide, the classificatory problem) ; and (c) to identify the "actor” groups 
promoting, preserving, or resisting the process of change "in countries which arc 
moving from traditional to modern ways of life” {vide, the conceptual problem). 

Similarly, the IP-statistic may be profitably employed to characterize the 
social spaces which are internally homogeneous with respect to the characters brought 
up to denote the homogeneity, and arc mutually distinct under the same term of 
reference. This would be a useful line of research as implied from the field-work of 
some anthropologists (cf. Ciccrtz, 1959). And. particularly, this would have an impor¬ 
tant bearing on the understanding of a society subjected to a specific social force, etc. 

For example, in order to appreciate the social forces working in rural Tndia. 
generally we concentrate our attention on “villages" selected purposivelv, or at ran¬ 
dom, within a given field ; viz., a State, a District, or a region defined in any other 
wav. An operational advantage is obviously implicit in this method because as units 
of administration villages represent precisely-defined easily identifiable spaces. But 
"village studies”, as conducted by most of us. do not depend only on this operational 
facility. Contrariwise, whether or not declared explicitly, it is frequently assumed 
that: “As a territorial, as well as social, economic and ritual unit, the village is a 
separate and distinct entity” (Dube, 1955, p. 7). 

This assumption on the uniqueness of villages in the social organization and/ 
or in the web of integration in the life and living of the rural folks is indeed so strong 
that the planned programmes of India’s rural development aro usually implemented 
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in terms of “village communities’’ as functional units and not merely as operational 
entities accepted in lieu of a better knowledge of the social spaces involved in intro¬ 
ducing the developmental measures; viz. intra-village, inter-village, or village-wise 
levels of integration and social organization of the people concerned. 

And this is so even when there are plenty of evidence to indicate that in many 
respects, and in several vital respects at that, the social organization of the people 
and the web of their social relations cut across the village boundaries or are restricted 
to resjiective segments of village populations (e.g., Singh, 1901). There are also 
a priori information pointing to the fact that this social atmosphere is almost invari¬ 
ably limited within a discernablc sjhicc (when transgressing the village boundaries) 
which, for the present, may be broadly ami vaguely labelled as a neighbourhood. 

Ft is essential, therefore, to ascertain in rcsjicct of a selected list of societal 
parameters whether within a given field the villages function as homogeneous or hr/un¬ 
generous entities (Clinttopadhyay and Bandyopadhyay, 1902) and/or as units 
or variables (Mukhcrjee, 1901); and whether ” neighbourhoods" characterized in the 
above sense and as conforming to social (and not merely physical) reality can be identi¬ 
fied therein. Either way (which are, in fact, complementary to each other), a /^-ana¬ 
lysis can give a precise characterization of the social sjtaces on the basis of the charac¬ 
ters which should be brought under consideration for the purpose, like some consi¬ 
dered unrelalcdly for the above-mentioned two papers. 

Studies on the two issues cited above are being conducted at present in tho 
Sociological Research Unit of the Indian Statistical Institute. Like them, more 
issues and problems could be cited in respect of which the /^-statistic can be a valuable 
aid. Because, just as the social, economic, ritual, or any other type of attributes with 
reference to a societal entity like the family, caste, etc., are justifiably claimed to be 
organically inter-rclntcd with varying orders and degrees of emphasis among them¬ 
selves, so arc the anthropometric measurements with reference to a biological entity ; 
—a man or a woman, for instance. Therefore, tho situation which in 1925 gave the 
impetus to the evolution of the D*-statistic in particular reference to anthropological 
data (Mahalanobis, 1925) is found to be equally present in social research. 

The main hurdle in this respect lies, of course, in the quantification of sociolo¬ 
gical data ; viz., the translation of the attributes under reference into continuous 
variates. For. although in many instances the quantification of sociological observa¬ 
tions follows directly or with some additional efforts and intensive investigations, as 
yet this is a field trodden by only a few and that also in fewer instances. Even so, 
that may not be the insurmountable difficulty. Because, to refer to the above 
analogy, if anthropometry could have outstripped anthroposcopy in due course, and 
if from esoteric or •‘over-all” appreciation the quantification of economic, psychologi¬ 
cal and biological observations could have increasingly gained momentum in the 
last few decades, so may the quantification of sociological data vis-a-vis their impres¬ 
sionistic rendering, provided conscientious efforts are made in that direction. 
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And, in that case, just as Mahalanobis's D z has been profitably employed by 
the physical anthropologists and their statistican colleagues (e.g., East and Oschin- 
sky ; Majumdar, Mahalanobis, Mukherjee, Rao, Trevor, etc.) and just as its hesitat¬ 
ing use in the fields of biology, psychology, economics, etc., has also produced divi¬ 
dend (e.g. Chakraverti, Nair, Poti, Rao and Slater, Stone.), so may its application 
in the virgin but fertile field of social research. 


TABLE l 


characters 

•'social’' classification 

N 

Z):>valuos botweon categories 



categories 


H. M 

H- 

H, 

T 

0 ) 

( 2 ) 

(3) 

(4) (5) 

( 6 ) 

(7) 

( 8 ) 


Hindu "high” custes (H,) 

49 

0.70 

1 .04 

2.34 

10.41 


Muslim community (M) 

302 


0.73 

0.84 

8.25 

(0 + 6 +C + d + t) 

Hindu "middle'* castes (H s ) 

432 



0.20 

5.71 


Hindu "low" caste* (Hj) 

454 




3.77 


Tribuls (T) 

42 






Hindu "high" castes (Hi) 

49 

0.07 

1.30 

1.04 

3.60 


Muslim commimity (M) 

302 


0.01 

0.40 

2.04 

(a + 6 +e + d) 

Hindu "middle" castes (H.) 

432 



0.10 

1.38 


Hindu "low" enstos (H s ) 

454 




0.03 


Tribuls (T) 

42 






Hindu "high" castes (H,) 

49 

0.00 

1.25 

1.51 

2.73 


Muslim community (M) 

302 


0.55 

0.33 

1.17 

(« + 6 +e + e) 

Hindu "middle" castes (H;) 

432 



0.18 

0.85 


Hindu "low** cantos (H,) 

454 




0.43 


Tribals (T) 

42 






Hindu "high" cantos (H.) 

49 

0.00 

1.22 

1 .60 

2.02 


Muslim community (M) 

302 

_ 

0.53 

0.33 

1.04 

(a+ 6 +e) 

Hindu "middlo" castes (H,) 

432 


-- - 

0.10 

0.60 


Hindu "low" castos (Hj) 

454 




0.20 


Tribals (T) 

42 






TABLE 2 

characters 

"oconomic" classification 
catogorios 

N 

Z)?-vuIuoh botweon categories 


pn 

dl 

th 

ob 

( 1 ) 

( 2 ) 

(3) 

(4) 

(5) 

( 6 ) 

(7) 

(a + 6 + c + d + e) 

peasants (pn) 
day labourers (dl) 
technical hands (th) 
clorks/businossmon (cb) 

199 

267 

635 

178 


1.63 

3.36 

0.53 

8.66 

2.96 

1.62 

'a +6 + c4 d) 

peasants (pn) 
day labourers (dl) 
technical hands (th) 
clerks/businossraon (cb) 

199 

207 

636 

178 


0.14 

0.22 

0.23 

n.04 

0.37 

0.41 

(a+ 64 c+e) 

poasunts (pn) 
day labourers (dl) 
technical hands (Us) 
clerks /businessmen (cb) 

109 

207 

635 

178 


X 

0.30 

0.09 

0.83 

0.50 

0.28 

(a + 6 +c) 

peasants (pn) 
day labourers (dl) 
technical hands (th) 
clorks/businossmon (cb) 

199 

267 

635 

178 


X 

0.22 

X 

0.48 

0.34 

0.24 


Kotc : x indicates that tho D=-valuo is not significant at tho 


lovol of significance, 
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TABLE 3 


"social” classification 


level of significance of tho inc rease in 
£>?.values due to additional character 

categories — 

H, 

M 

H: 

H, 

T 

( 1 ) 

(2) 

( 3 ) 

O) 

( S ) 

( 0 ) 

addition of charactor («/) to (a + t + c) 

Hindu "high" castes (H|) 

— 

+ 

0.05 

0.05 

0.001 

Muslim community (M) 


— 

0.001 

0.001 

0.001 

Hindu "middle” castes (H s ) 



— 

+ 

0.001 

Hindu "low” castes (Hj) 




— 

0.001 

Tribals (T) 





— 


addition of character («) to (a+ 6 + e) 


Hindu "high" caste* (If,) 

+ + 

+ 

+ 

Muslim community (M) 

— 0.10 

+ 

0.05 

Hindu "roiddlo" caste* (tl,) 

— 

0.10 

0.001 

Hindu "low" castes (H,) 


— 

0.01 

Tribals (T) 



— 

ATotr ; + indicates tho 

"level of significance" ns greater than 0.20 


TABLE 4 



"economic" classification 
categories 

level of significance of tho increase, in 
Z)*-vn!ucs due to additional character 


pn dl 

th 

cb 

(1) 

(2) (3) 

(4) 

(6) 

addition of character (d) to (a+b+c) 

peasants (pn) 

0.01 

+ 

0.001 

day labourers (dl) 

— 

0.001 

0.20 

technical hands (th) 


—— 

0.001 

clorks/businessmen (cb) 



— 


addition of character («) to (a-i-6-fc) 


peasants (pn) 

— 

0.05 

0.001 

0.001 

doy labourers (dl) 


— 

0.01 

0.001 

technical hands (th) 



_ 

0.01 

clerks/businessmen (eh) 




_ 


36 


Note : + indicates the "level of significance" aa greater than 0.20 
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: * indicates that the Devalue is not significant at the 1% level of sij 



units of “social" classification 

(with abbreviation) against N £)-• values between the units for characters (a+6+e+d+«) 
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x indicates that the Z)*.value is not significant at the 1 % level of significance. 



f economic categories of -values between the categories for characters (a+b+c+d+e) 

stion conforming to those N - 

in Tables 1 and 2 H,cb H,dl H-pn Mcb H,cb H ; cb Mth Hjth Hath 
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Note : x indicate® that the Devalue is not significant ot the 1% level of significance. 
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ON MAHALANOBIS’ CONTRIBUTIONS TO THE DEVELOPMENT 
OF SAMPLE SURVEY THEORY AND METHODS 


By M. N. MURTHY 
Indian Statistical Institute 


1. Introduction 

Professor P. C. Mahalanobis’ work in tho field of samplo surveys during tho 
Inst three decades has been so fundamental and varied in naturo that it is almost 
impossible to review completely all of his contributions. In this review it is proposod 
to concentrate more on his work relating to tho mothodology of samplo survoys rather 
than covering the innumerable survoys that havo been carried out under his direction 
and guidance during tho last three decades or so. Mahalanobis' methodological 
contributions to tho field of samplo surveys may bo classified broadly into tho following 
categories : 

(i) development of sampling theory with emphasis on variance and cost 
functions; 

(ii) evolution of statistical techniques for assessment and control of errors 
in surveys; and 

(iii) organisation of large scale survoys. 

It is proposod to review briofly his work under oach of those catogorios aftor giving a 
brief historical note in Section 2 on the oarlier developments in this fiold. 

Many of tho contributions of Mahalanobis are available in published form 
in many scientific journals. His memoir (1044) “On Largo Scalo Sample Survoys" 
published in the Philosophical Transactions of the Royal Society embodies tho theoreti¬ 
cal set up ho had evolved in planning samplo survoys and his paper (1946a) on “Rocont 
Experiments in Statistical Sampling in tho Indian Statistical Institute" published in 
tho Journal of the Royal Statistical Society gives a detailed account of a number of 
statistical experiments conducted by tho Indian Statistical Institute under his direction 
and guidance. Mahalanobis has given details of more recent statistical experiments 
earned out in tho Institute under Iris general guidanco in a sorics of locturos delivered 
at Tokyo in 1958 and in his paper (with Lahiri, D. B.) (1961) on “Analysis of Errors in 
Censuses and Surveys with Special Emphasis on the Experience in India" published 
m the Bulletin of the International Statistical Institute. A list of his papers referred 
to m this review is given at the end of the paper. 


HISTORICAL NOTE 


Mahalanobis, originally a physicist, got himself interested in statistics as long 
back as 45 years ago. In a sense his orientation in physics served as a starting 

tonal m ‘ mpOTt * nt “ nd p,onoerin K work in assessing and controlling observa¬ 
tional, measurement and experimental errors in statistical surveys. Another facet 
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of liis work in this field, which is influenced by the limitation of the available 
resources for statistical work in India, relates to his emphasis on the consideration 
of cost aspect in designing and conducting statistical experiments and surveys. 

2.1. Earlier developments. To enable appreciation of the contribution of 
Mnhalanobis to sample surveys in its proper perspective, it is proposed to give a very 
brief review of the developments in this field prior to 1930. Kiaer, who had realised 
the importance of the method of representative sampling almost 70 yoars ago, 
had conducted some surveys in Norway as early as 1900 and he was instrumental 
in focussing the attention of the International Institute of Statistics on the noed 
for application of the representative method in statistics and almost about this time 
Wright had conducted statistical surveys in the United States using this method 
(Seng, 1951). Zarkovic (1956, 1962) mentions the use of sampling method in Russia 
ns early ns 1900. He has also drawn attention to a book on sampling methods by 
Kowalsky published in 1924. 

In India the need for random sampling in statistical survoys was perhaps first 
recognised by Hubback ns early ns 1923 or even earlier. In his report on “Sampling 
for Rico Yield in Bihar and Orissa (1923-25).” published in 1927, Hubback (1940, 
p. 283) hns stated : 

“The only way in which a satisfactory estimate can be formed is by as close 
an approximation to random sampling as the circumstances permit, since that not 
only gets rid of the personal limitations of the experimenter but also makes it 
possible to say what is the probability with which the results of a givon number of 
samples will bo within a given range from the mean. To put this into definite 
language, it should bo possible to find out how many samples will bo required 
to secure that tho odds are at least 20 : 1 on the mean of the samples being 
within one maund of tho true moan.' 


Mahalanobis (1946b). who publicised tho work of Hubback by republishing his report 
in Sankhyd and reviewing his work, states that Fisher's work at Rotlmmsted had boon 
directly influenced by Hubback's paper. Fisher (1925) emphasised the need for rando¬ 
misation, replication and statistical control in scientific experiments. Clapham (1929) 
discussed the use of sampling method in estimation of yield of cereal crops. 
Nemchinor (1932) has given in detail tho methods usod in tho USSR for forecasting 
crop yield through extensive crop cutting experiments. 

The Committee on tho “Application of the Representative Method in Sta¬ 
tistics ” set up in 1924 by the International Statistical Institute, prepared its report 
in 1925 in which tho theoretical and practical aspects of the random sampling method 
have been discussed (Jensen, 1926). Bowloy's (1926) contribution to this report on 
tho question of stratification and allocation is of particular importance. 

From this brief review of the earlier developments, it would be clear that 
objective planning of statistical surveys is of fairly recent origin and that pnor to 1930 
importance of the method of random sampling had not been widely recognised. In 
^ cC evcn in tho report on tho representative method referred to above, considerable 
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prominence was given to the motho<l of purposive selection. The idea of giving 
this brief review, ns pointed out earlier, is just to give the background to Mahalanohis 
pioneering work in the field of sample surveys. It is quite possible that in the 
days when ho started work on sample surveys, Mahalanohis was not even aware of 
all the earlier developments. 

2.2. Acquaintance with sample surveys. The earliest recorded reference to 
Mahalnnobis' acquaintance with sampling theory, which I have come across, relates to 
his lecture on Elements of the Theory of Sampling delivered on the 8th of July 1032 at 
the Statistical Laboratory, Presidency College, Calcutta. In this lecture, he discussed 
the concept of population in statistics by comparing it with that of universe of 
discourse in logic and stressed the distinction between the population value and sample 
value and the need for probability interpretation of the observed statistics. It is of 
interest to mention that Mahalanohis discussed tho same topic in a seminar held in the 
Indian Statistical Institute on the 15th of March 1903. In his lecture, he summed 
up tho essential features of a sample survey in his characteristic manner in tho sentence 

"a sample consists of two or more eletnentary units drawn from a population 
(universe or field) in a random manner through tho sample frame, and t he inference 
about tho population is based on the obscrveitions, measurements and experiments 
on the variates (or characteristics) of the elementary units in tho samplo” 

and he briefly discussed tho origin and tho significance of the various terms used in 
samplo survoys. 

From tho beginning Mahalanohis clearly recognised the immense potentia¬ 
lities of the method of random sampling and nlso the need for proper interpretation 
of samplo survey results. In an editorial note on the paper "Price of Rico at Bolpur” 
by Santipriya Bose, who had discussed the results of a survey without any reference 
to their margins of error, Mahalanohis (1930) pointed out that the margin of error 
in tho results of tho survey discussed in the paper is rather large and that the margin 
of error of even the key characteristics is of tho order of 5 per cent for the samplo 
of 15 holdings used in tho survey. He further pointed out that to get a margin of 
1 por cent it would bo noccssary to have a larger sample of about 500 holdings. 

Again, in anothor editorial note on tho paper "The Future Trend of Popula¬ 
tion Growth in India” by B. P. Adarkar, which had given rise to considerable 
controversy, Mahalanohis (1937) commented that the data on which the paper was 
based wore likely to bo unreliable and stated : 

"A census (or complete enumeration) method of studying differential fertility 
is impracticable in India owing to vast numbers. Recourse to a sample survey 
method is, therefore, inevitable. Fortunately, owing to recent developments in 
statistical theory of representative and stratified random sampling, the efficiency 
of this method has increased very appreciably. The cost is also not prohibitive.” 
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Witli regard to the question of crop statistics, Mahalanobis (1940a, p. 512) 
mentions : 

“In March 1936, in reply to the enquiry from the Secretary, Imperial 
Council of Agricultural Research, I suggested exploring the possibilities of random 
sample method for estimating the area under different crops in Bengal.” 

It may be mentioned that at present in India inter-censal population and other 
demographic statistics and annual figures of crop acreage and production are being 
estimated on the basis of objectively designed largo scale sample surveys. Since 
1930, Mahalanobis has conducted quite a number of statistical surveys relating to 
a wide range of subjects, such as, crop acreage, consumer expenditure, cost of living 
index, consumer preferences, labour enquiries, refugee rehabilitation, transport 
statistics, life of rupee notes, etc. These subjects are being mentioned to illustrate the 
variety of problem he would have had to face in planning and executing these surveys. 

2.3. Indian Statistical Institute.. In 1932 the Indian Statistical Institute 
(ISI) was founded in Calcutta by Mahalanobis to promote work in statistics by 
providing facilities for research and training and by undertaking statistical projocts. 
This Institute soon developed into a centre of statistical activities in India and has 
acquired international recognition. Mahalanobis, as its Director and Secretary, has 
been the guiding spirit of the Institute for tho last three decades. In 1959 the Go¬ 
vernment of India, through an act of Parliament, declared tho Institute to be of 
national importance and ompowered it to confer degrees in statistics. In his annual 
review in 1940, Mahalanobis (1940b, p. 444) stated : 

"It has always been the policy of tho Statistical Laboratory and the Indian 
Statistical Institute to omphasise tho fact that statistics is an applied scionco 
and that its ultimate justification lies in tho promotion of human welfare.” 

Again, in his annual review at the Indian Statistical Conference in 1942, 
Mahalanobis (1942a. p. 10) said. 

"The Institute is becoming increasingly interested in developing the theory 
and technique of sample surveys. ... In practical affairs wo have to make our 
decisions on the basis of samples. That is why the technique of sampling is of 
such vital importance in real life." 

On the occasion of the formal opening of tho main building of the Institute 
in 1951, R. A. Fisher said 

"... it (ISI) has taken the load in the original development, of tho techni¬ 
que of sample surveys, the most potent fact finding process available to modern 
administration, while at the same time it has harboured a series of brilliant 
mathematicians of world reputation in mathematical statistics.” 

2.4. Systematic contribution to sample surveys. Mahalanobis' systematic con- 
tribution to sample surveys may be considered to have commenced with bis scheme for 
sample census of jute crop in Bengal prepared as early as 1937. This scheme was for 
estimating the acreage under jute and yield of jute crop in Bengal and this was phased 
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over five years. In a souse the approach adopted in this scheme was sequential. In 
the first year the survey was confined to two thnnas (groups of about 100 to 200 vil¬ 
lages) in Bengal and the survey was gradually expanded to culminate in a large scale 
sample sur '"ey in 1941 covering the whole of Bengal. The survey in initial years was 
so planned as to provide data on variability of the characteristics under consideration 
and on costs of the different survey operations, which eould be used for designing the 
largo scale sample survey efficiently and with minimum cost. His work on the crop 
survey in Bengal was so successful that the Government of Bihar requested him to 
carry out a similar survey in Bihar. Sinco then he has carried out a number of surveys 
at the instance of the Central and the State Governments and other agencies. 


As has been pointed out earlier, ho recognised the need for assessing and con¬ 
trolling non-sampling errors especially in largo scale surveys. During the sample 
census on jute crop in Bengal, he developed the technique of interpenetrating net-work 
ot sub-samples and other techniques for assessing and controlling non-sampling 
errors I„ short, randomization, statistical control and cost were his watch-words and 
throughout Ins work in sample surveys, ho has boon emphasising these three most 
important factors in large scale surveys. 


2.5. National Sample Survey. As the Chairman of the National Income Couimi- 
ttce, set up m 1949, and a, the Honorary Statistical Advisor to tho Government of 
India Mahalanobrs foond large gap, in data needed for national income computation and 

Zrv*?. r' 8,01 V,‘ mattera r ° lati,,g 10 aoc '°‘ oc<mom ' c condition. Of the 

rSELiVST?"" l ‘ e , h ° Pr ° Par0d “ SC,10 "‘° f0r organising 

The Con!^ ?T y ' Ch W “ apprOVed b y lh ° Government of India in .950 

bl nfl TT P y <NSS)> Whi0h U •*» '-mest sample survey of its kiud to 

. become an .mportant agency for collecting various typos of data Tho NSS 
■s a mu f-subject continuing survey being conducted with a ^o-timo staff I t 

check on tho validity of the survey results. ^ IOVe ' a " d S * rV “ “ “ broud 
Fisher and others (1967)* reviewing the work of the NSS said - 

satisfll n 4 0 il h t te STSST are 7 U laid ° Ut and arc “ 

illustrated Iry tho Na'nal ^ ^ “ 

whoro in the world.” y ’ “ g fc bo most progressive any- 


sot up in , 9S6 T. w>Uch was 

tho National Samplo Survey. ^ “ d A Lmdor “ «•,ember., to review the work of 
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2.G. Pioneering work of Mahalanobis. An idea of tho pioneering nature of the 
work of Mahalanobis in sample surveys can be had from the statements given below. 

Hotelling (1938) in his report to the Indian Central Jute Committee, prepared 
after a careful examination of Mahalanobis' scheme for a sample census in Bengal, 
states : 


'‘...no technique of random samples has, so far as I can find, been developed 
in tho United States or elsewhere, which can compare in accuracy or in economy 
with that described by Professor Mahalanobis/’ 

After briefly reviewing Mahalanobis' work in the field of sample surveys, 


Seng (1951) says : 

“India can therefore usefully claim to stand with the United States as 
amongst tho foremost users of tho sample method in social and economic research. 
And it is a very happy combination, for in the United States wo have tho typical 
example of an industrial and highly developed country while in India tho condi¬ 
tions approximate more nearly to thoso of a country not so highly developed, or 
more specifically, to tho conditions of thoso countries, which, like China, have 
no genuine statistics, and where such statistics, if they are to be obtained at all, 
have to bo obtained mainly by sample surveys, for which tho experience of India 
will servo as a guidance and as example worthy of imitating.” 

Yates (1951), emphasising the value of tho pioneering work of Mahalanobis in tho 
field of sample survoys, said in a talk on the work of the United Nations Sub-Commi¬ 
ssion of Statistical Sampling broadcast by the Calcutta station of the All India Radio. 

“Ho (Mahalanobis) consequently, recognised more clearly than most, that if 
more world censuses were to be properly carried out in tho less-developed coun¬ 
tries, the use of sampling method would be essential and it was he who proposed 
the setting up of the Sub-Commission on Statistical Sampling in order to assist tho 
work of proper application of sampling mothods.” 

Fisher (1962), while recounting his early association with Mahalanobis and lus 
work, said at tho first convocation of tho Indian Statistical Institute, 


“I need hardly say that I refer to tho emergence of a statistically competent 
technique of Sample Survey, with which I believe Professor Mahalanobis name 
wUl always be associated. What at first most strongly attracted my admiration 
was that the Professor’s work was not imitative. 


3. Development of sampling theory 
_ . • * , Professor Mahalanobis was perhaps the first 

3.,. joint consideration of sa.npHng errora, 

person to recognise y ^ I statistical surveys based on tho principle 

non-sampling errors and cost it * cloar that he had used 

of random sampling. ro “ a procedures currently being used in samplo survoys. 

many of the selection an e=> ima 10,1 ^ considered by Mahalanobis in his surveys 

aro 8 ^^!^ 11 random U sampling, systematic sampling, grid sampling, cluster 



SAMPLE SURVEY THEORY AND METHODS 


280 


sampling, varying probability sampling, stratified sampling, multi-stage sampling and 
multi-phase sampling. As regards the* question of costs, he had made extensive studies 
to build up suitable cost functions for different situations. It can be safely said that 
he has contributed in a large measure to the rapid development of sampling theory 
by not only proposing new methods but also by actually demonstrating their poten¬ 
tialities and usefulness in practice. 

From the beginning Mahalnnobis appears to ho very clear about the principles 
involved in designing a sample for a statistical survey. In his report on sample survey 
of acreage under jute in Bengal, Mahalnnobis (1040a, p. 513) gives a comprehensive 
formulation of the principle of sample designing ns follows : 

"From the statistical point of view our aim is to evolve a sampling technique 
which will give, for any given total expenditure, the highest possible accuracy in 
the final estimate. For this it is necessary to determine three things, namely, 

(a) what is the host sizj of the sample units; 

(b) what is the total number of such sampling units which should he used to 
attain the desired degree of accuracy in the final estimates; and 

(e) what is the best way of distributing these sampling units among different 
districts, regions, or zones covered by the survey.” 

While elaborating on the principle of sample designing for a crop survey 
taking into account the cost aspect, Mahalnnobis (1942b, p. 9K) statos : 

"The total cost being given, we have to find what is tho area of each 
sampling unit; how many such sampling units should he used altogether; how 
these should lx allotted to different classes of land; and how the sampling units 
assigned to each class of land should Ik* distributed geographically in order that 
tho margin of error in the final results would he reduced to a minimum. Alterna¬ 
tively, wo may define the objcctivo in a slightly different way. The order of 
accuracy in the final results being given, wo have to find what would he the best size 
ond distribution of the sampling units in order to do the work at a minimum cost." 


An important feature of Mnhalanobis* scheme for sample surveys is the phasing 
of the work relating to the survey by first conducting exploratory studies to get a 
very rough idea of tho nature of the variability of the characteristics under considcra- 
t.°n and tllc cost of different survey operations, and gradually expanding tho survey 
to result in a full-fledged survoy, planned efficiently on the basis of the data collected 
and the experience gained during the exploratory stage of the survoy. For instance, 
m tho scheme for a sample survoy of jute crop in Bengal as has boon explained before 
the survey was phased over five years (1937-41) with the full-fledged survey covering 
tho whole of Bengal taking plaee in 1941. Wald (!947) has drawn attention to this 
survoy n, the introduction to his book Serial Analysis and has state,1 : 

• The occasional practice of designing a large scale experiment in successive 
s ages may be regarded as a forerunner of sequential analysis. The idea of such 
chain experiments was briefly discussed by Harold Hotelling (1941) A very 
interesting example of this type in the series of sample censuses of area of jute in 
37 
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Bengal carried out under the direction of P. C. Mahalanobis (1940a). Mahalanobis 
(1952) has discussed the advantages of sequential sampling by considering what 
he terms, historical and non historical designs .” 

It is ol interest to note that Mahalanobis had not only considered estimation 
of certain population parameters, such as, average, population total, ratio etc., but had 
also given considerable attention to the question of estimating, what ho terms, abstract 
distribution and space distribution of the variates with the help of sample surveys. 
Ho terms the latter problem as mapping surveys. 

3.2. Theoretical formulation. It is proposed to give here briefly the theoretical 
set-up developed by Mahalanobis (1944) in connection with the sample survey of dif¬ 
ferent crops in Bengal. In his theoretical formulation he had followed a generalised 
approach to the basic problems of sample surveys. 

Let us consider a geographical region of finite area consisting of a finite 
number, say iV 0 , of basic cells of smallest area measured in suitable areal units. 
The basic cell, termed guad and denoted by the symbol Q. can be considered to bo the 
elementary unit. A quad can bo uniquely identified by a pair of coordinate numbers 
(*, j), * ■= L 2, 3, ... /; and j = 1. 2, 3, ... m; 
where Im = iV 0 Q = A, geographical aroa of the region. Let z(i, j) bo the value of the 
variate z for the quad □ corresponding to tho pair of coordinate numbers (», j). 
Mahalanobis defined a field as 

“A field in the sense of the present paper thus consists of a finite number, say N 0 , 
basic cells arranged in a definite space or a geographical order together with a 
single value (or a set of values in the multivariate case) of z, for each basic cell.” 

I*'or a particular field, where the value of z for each basic cell is uniquely 
determined, the set of iV 0 values of zis said to constitute an abstract selof z. In the case of 
an actual field the N 0 values of z have a definite space distribution and the statistical 
properties of this space distribution are of great importance. The distinction between 
abstract distribution of 2 and the space distribution of z can be easily understood by 
noting that corresponding to any given abstract distribution of z, there are 2V 0 ! space 
distributions, if all the N 0 values of 2 arc all different. 

With this set-up, Mahalanobis has considered the following four types of sampl¬ 
ing-unitary unrestricted, unitary configurational, zonal unrestricted and zonal 
configurational—which, in modern terminology, correspond to unrestricted simple 
random sampling, unrestricted cluster sampling, stratified simple random sampling 
and stratified cluster sampling, respectively. 

Unitary unrestricted (unrestricted simple random) sampling relates to selection 
of w basic cells with equal probability. In unitary configurational (unrestricted cluster) 
sampling, a sample of groups of cells, where the cells in each group are arranged 
in any particular geographical configuration, which can bo termed a grid, is selected. 
For instance, square shaped blocks of 4, 9, 1G, .... m* adjoining basic cells are grids 
of the corresponding number of quads. In case of zonal (stratified) sampling, sampling 
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of colls or groups of cells (grids) is done separately in each of tho zones or strata in 
which tho whole field is sub-divided. 

Maha la nobis has discussed the question of classification of holds by consider¬ 
ing sampling of n 0 basic colls directly and sampling a grid of n 0 basic colls. Lot N 
denote the total nurabor of spaco distributions corresponding to a given abstract 
distribution (iV < A' 0 I). Corresponding to any space distribution, say s, lot there bo 
N' possiblo positions of tho grid of n 0 colls. Similarly lot N" bo tho number of samples 

of n 0 basic colls ( N m = (* V °)). A sample of ono grid with n 0 cells may bo denoted 

by Or (* 0 ) and a sample of n 0 cells selecte<l directly by R(n 0 ). Let tho est imators in 
tho two cases be 

Ugf (Gr(n 0 )), 4=1.2. N ; <-1,2 . N\ ... (!) 

8 - 1, 2, .... N-, <=1.2 . N\ ... (2) 

Since in tho latter case N" sets of n 0 cells are identical for all tho spaco distributions 
(5— 1,2. N), tho estimator may bo written as 

«,{/?(«<>)}. <“ 1.2, ... N\ ... (3) 


By comparing the distribution of u„{Glr(M 0 )}, say F g {G/(w 0 )} with that of 
* a y F 0 {7?(» 0 )}, a particular field can be defined to bo a random field if F, {0/(/»„)} 
is indistinguishable from F 0 {R(n 0 )) and a given field for which tho distribution of tho 
statistic u„ (GV(/i 0 )} is statistically different from that of u, {R(n 0 )) is defined as a non- 
random field. 

Considering tho variances of the estimators i/„{C?r(w 0 )} and M|{/f(/» 0 )}, Maliola- 
nobis suggested the ratio 



where <r 2 denotes the variance, as a simple criterion for the separation of random and 
non-random fields. In case of unitary unrestricted (unrestricted simple random) 
sampling, ho has shown that 


for a finite population and that 

■7*{«(n 0 )} = 

for an infinite population. 


In the case of zonal (or stratified) sampling, the estimator of the total value 
for the whole area is given by 


... (7) 
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where A k and z k aro respectively the area and the estimator of the value per unit area 
of the variate z in the fc*th zone (or stratum) and tho sampling variance of z, in its 
general form, is 

v ( z ) = ^ i A k^ f k[Or t (n 9k ), w k ) ... ( 8 ) 

where i/r k is the variance function in the fc-th zone or stratum, which depends on tho 
grid pattern Gr k , grid size m 0 * and w k ( = n t /A t ), the density of grids per unit area, 
n t being the number of grids in the sample from tho fc-th zone or stratum. On the 
basis of extensive empirical studies, Mahalanobis has conjectured that the variance 
function takes tho form 

JS A L {b t /w k (n oL ) 0k } ... (9) 

where b k and g k are constants. The cost functions, in its general form, is given by 

T = i A k <f> k {Gr k {n ok ), w k ) ... (10) 

*-i 

whore tf> k is the cost function for the k- th zone or stratum. For a given total cost T 0 , 
tho optimum values of n 0 * and w k can be obtained by differentiating 


V+\(T-T 0 ) 


(H) 


with respect to n ok and w k . 

In the case of zonal unitary (sfratified simple random) sampling, where 
n ok = 1 , the variance and cost functions can be taken to be of the form 


V-£AMw k , ... ( 12 ) 

*-» 


T = T'+ S A# k w k , ... (13) 

where T' is the over-head cost and c k is the cost of surveying one sample unit. The 
optimum valuo of w k , in this case, is given by 

V? - <“* 

S A, Vb*> C ‘ 

which, when c k = l, reduces to 

w k = y° ^ ^ y/b k or n k aA k y/b k , ... (16) 

2 A k y/b k 

*-l 

which is the optimum allocation proi»o.se<l by Noyman (1934). 

Mahalanobis (1944), while discussing the properties of fields, has considered 
in detail the correlation function and has also extended the theoretical set-up, evolved 
in case of uni-stage sampling, to the case of multi-stage sampling. Ho has also discussed 
the nature of ©occurrence of crop patches in random and non-random fields giving 
results of suitable empirical studios. 
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3.3. Selection procedures. In his exploratory studies on crop acreage and pro¬ 
duction, Mahalanobis has used different selection procedures whieharo commonly being 
used now. For instance, in 1937 ho conducted exploratory studies on crop statistics 
in 20 mauzns (villages) randomly selected with equal probability from Iktituis (groups 
of villages) and in 5%of the plot** selected systematically from some of the selected 
villages. In case of crop yield surveys, he used a multi-stage sample design with 
niauzas (villages), grids within villages, plots within grids and cuts of different sizes 
and shapes as the different stage units. 

It is clear that he was familiar with the method of probability proportional to 
sizo even as early as 1937, sinco in his report on experimental crop census conducted in 
1937, ho states that for obtaining valid estimates, it would bo necessary to select the 
plots using the cumulative totals of their areas, sinco the area of plots varies consider¬ 
ably. Proceeding, ho states that it would be impracticable to select the plots with 
this procedure as the workload involved would be excessive. Because of this consider¬ 
ation and duo to tho fact that the cost of journey between plots widely scattered ovor 
the region would be high, ho recommended tho use of grids, thosizoof which, ho pointed 
out, should bo decided on tho basis of empirical studios taking into account tho variance 
and cost functions. 

For estimating tho yield of cinchona bark Mahalanobis used a multi-phaso 
sample design which he termed multiple survey or multiple sample. In tho first phase 
a number of physical measurements such as girth, height, number of shoots, surface 
area of the plant, etc. were made on a number of standing plants seloeted at 
random. A sub-sample of these plants^were uprootod for detormiuing the yiold of 
bark. An estimate of tho yiold of bark was obtained with tho help of regression ana¬ 
lysis technique using tho measurements of the plants collected in tho first phase of tho 
survoy. 

Another example of multi-phase sampling given by Mahalanobis relates to 
tho crop production survey, where acreage data were collected from a large sample 
of grids and yield data were collected from a relatively small sample of cuts located 
at random in a sub-samplo of fields taken’up for’acrcago survey. Further in caso of 
crop cutting surveys tho green weight of the harvested crop (say, jut© or paddy) was 
obtained immediately after harvesting, whereas in only a fraction of those cases (of 
the order of 10 %) the jute plant was soaked, retted and the dried fibre extracted foe- 
weighing or the paddy was dried, husked and tho weight of rice was determined. 

It is of interest to note that as far back as 1937, Mahalanobis ( 1945 . p. 97 ) had 
considered the possibility of air-surveys using specially sensitized films for estimation 
of crop acroage. 

3.4. Grid sampling. As mentioned earlier Mahalanobis recommended the use 
of gnds as sampling units in crop surveys, since the selection of plots with probability 
proportional to area after cumulating their areas would bo impracticable and since 
surveying sample plots spread over a large area would bo uneconomical. Grids of 
square shape are located with tho help of randomly selected points on tho cadastral 
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maps showing plot (or field) boundaries. The random point locates a specified corner 
(such as south-west) of the grid with its sides parallel to north-south and east-west 
directions. The location of random point on the map is done by a simple instrument, 
termed coordinatograph, designed by Mahalanobis. A sketch of this is shown in 
Figure 1. The areas of plots falling in the grids are measured by superimposing an 
acre-plate having squares of size 0.01 acre marked on it. A specimen sample grid with 
the acre-plate superimposed is shown in Figure 2. 



Figuro I. A skotch of coordinate graph used Figure 2. 

to locate a random point. 

Since the grid is an artificial samplo unit, it may cut across tho plot (or field) 
boundaries. To obviate this difficulty, Mahalanobis considered tho possibility of 
including in the sample all those plots having major part of their area included within 
the grid and termed this the half unit method. He recognised that this procedure 
would be biased and ho carried out studies to ascertain the value of this bias for grids 
of different sizes. The results of these studies are given in Table 1. 


TABLE 1. ACCURACY OF THE HALF-UNIT METHOD 


observed 


sixo of grid 
in 

acres 

number of 
grids 

mean »ir.o 
of grid 

coefficient of 
variation 

(1) 

(2) 

(3) 

(4) 

- j 

66 

0.84 

49 

4 

61 

3.71 

25 

5 

50 

5.43 

16 

16 

53 

15.45 

9 

36 

20 

30.89 

5 


Source: Mahalanobis. P. C. (1938): Statistical 
roport on tho experimental crop census. 1937. 
Submitted to tho Indian Central Jute Committee. 


The deviation of figures in Column (3) from those in Column (1) and of tho figures 
„ I 1 m from 0 indicate the extent of bias and increase in variance resulting 
in Column (4) from 0 ^ t#b , e it u c , car that the bias and tho ...crease 

from the use of this proced ■ and thcse dccrcas0 ns the size of tho grid 

in variance are considerable f ° r ” f cxatl mcthod was used instead of this 

- — “ - - —— - 
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practice. The exact method in this ease consists in considering only those plots or parts 
of plots which fall inside the selected grid as in the sample. However, in observing 
tho crop proportion for border plots in the earlier crop surveys, the crop proportion 
obsorvod for the plot as a whole was applied to tho part of the plot inside tho grid to 
facilitate field work. 

3.5. Variance function. As has been pointed out earlier, Mahalanobis has 
stressed tho importance of studying the variance function on the basis of exploratory stu¬ 
dies and model sampling experiments for designing sample surveys efficiently. I'or ins¬ 
tance, in case of tho jute survey in Bengal he had carried out extensive studios on tho 
varianco and the cost functions with a view to determine tho optimum size of tho sampl¬ 
ing unit, which is the grid in the case of crop acreage survey and which is tho sample 
cut in tho crop yield survey and tho optimum geographical density of sample points. 

3.5.1. Crop acreage survey. Mahalanobis clearly realised that the varianco 
function in crop acroago surveys would depend on p, tho proportion of the area under 
the crop in the region, .r, the grid size and y. the geographical density of sample units 
and that tho variance would decrease with increase in x and y. On the basis of empirical 
studies he conjectured that the variance function of tho estimate of tho proportion 
of the area under tho crop in case of sampling of ono grid would bo of the form 



( 16 ) 


where 6 and g aro constants. 

It is of interest to note that tho varianco function assumes tho familiar binomial 
form pg, when x — 1/6. This gives a physical interpretation to the constant 6, which 
according to Mahalanobis, is tho reciprocal of tho largest possible unit aroa reporting 
1 or 0 for tho crop proportions. The rotative varianco of the grid sampling, compared 
to tho binomial caso, is given by 

P 1 a 

- < 17 > 

whero a and g aro constants. Table 2 gives the obsorved and graduated (using tho 
varianco function) values of the relativo variance E a . 


TABLE 2. OBSERVED AND ORADUATED 
VALUES OF THE RELATIVE VARIANCE 


grid siro 
in 

aero* 

number of 
nolicn 

relativo varianco vjpq 

stations* 

obsorvod 

graduatod 

(1) 

(2) 

(3) 

(4) 

1 

30 

0.2494 

0.2562 

2 

31 

0.1821 

0.1761 

3 

31 

0.1501 

0.1414 

4 

87 

0.1145 

0.1210 

6 

34 

0.1001 

0.0972 

9 

24 

0.0749 

0.0780 


•groups of village*. 

Source Mahalanobis. P. C. (1942c): Qonoral 
report on the saraplo census of tho area under jut© 
in Bengal. 1941. Submiltod to tho Indian Central Jut© 
Committee. 
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The value of g, in a number of empirical studies turned out to bo less than 1, 
though it varied from zone to zone. Mahalanobis pointed out that the value of g is 
determined by the degree of correlation between the crop proportion in neighbouring 
plots. In fact the intra-grid correlation and the parameter g arc connected by the 
relation 

1 . 

It was also found that the value of g decreased with incroaso in value of p, the crop 
proportion. 

3.5.2. Crop yield survey. As regards the question of shape and size of crop cuts 
in estimation of yield rates in crop surveys, Mahalanobis has conducted extensive 
studies and a comprehensive account of those studies is given by Mahalanobis and 
Sengupta (1051). It is of interest to note that in the earlier exploratory surveys, a 
sample cut was usually harvested in the form of sub-cuts, which helped in studying the 
behaviour of, the variance with changes in tho size of the cut. The shapes of cuts 
considered are triangular, rectangular, square and circular. Mahalanobis, following 
Hubback, has recommended the uso of small cuts in preference to large cuts in crop 
yield surveys both from the view point* of operational convenience and accuracy. 
He has recognised the possibility of getting over-estimates of yield rate from very 
small cuts and has demonstrated by actual experimentation that tho bias bccoinos 
negligible for circular cuts as tho radius is increased to 4' (cf. Tablo 4, item 5). It may 
be mentioned that in the National Sample Survey concentric circular cuts of radii 2'3" 
and 4' are boing used for estimation of yield rate of cereal crops. 

Mahalanobis (1940b, pp. 272-273) has used tho data collected by 
C. D. Deshmukh during his crop survey work in Central Provinco in 1928-30 to 
illustrate the study of variance function in two-stago design. Suppose <r\ and <r\ are 
respectively the variance of the mean yield rate between the villages and tho variance 
of tho yield rates between cuts within villages and lot n, and w 2 be tho number of 
villages and number of cuts per village respectively. Then the variance of tho 
estimator of the yield rate is of the form 


a\ + rr\ 


(18) 


n t ' n x n t 

Using the estimates of <r?and <r l based on tho data collected by Deshmukh. the number 
of villages required to be sampled to achieve a percentage error of 3% have been 
calculated for different number of cuts per village and the results are shown m lablo .. 
TABLE 3. ESTIMATED NUMBER OF VILLAGES AND SAMPLE CUTS 
REQUIRED FOR OETTINO A PERCENTAGE ERROR OF 3% FOR 

MEAN YIELD RATE _ 


number of villages required to bo sampled 


year 

1 cut 

2 cuts 

3 cuts 

4 cuts 

6 cuts 

1928 

1929 

1930 

434 

214 

366 

314 

120 

253 

269 

89 

214 

248 

73 

196 

230 

64 

184 


Sankhya, 7. 200-280. Table 2. 
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Commenting on this table Mahalanobis pointed out that there is substantial 
reduction in the number of villages required to be sampled when the number of sample 
cuts is increased from 1 to 2 or 3 and that the reduction is only marginal for increases 
in the number of sample cuts beyond 3. 

Another illustration of the study of tho variance function in case of crop 
yield survey with a multi-stage design is provided by tho survey of “arnan paddy 
in West Bengal in 1949-50. The design was a three-stage ono with locality (defined 
as circular area of radius ono mile demarcated round a centre located at random within 
a police station), grids of size. 2.25 acres and concentric circular cuts of radii 2'. 4' 
and 5' 8' jus first, second and third-stage units respectively. Analysis of variance 
based on tho data collected in this survey is given in Tablo 4. 

TABLE 4. ESTIMATED STANDARD DEVIATION OF THE MEAN YIELD OK 
AMAN PADDY (EXPRESSED IN MAUNDS OK CLEAR RICE PER ACRE) 

AT DIFFERENT STAGES OK SAMPLING BY SIZE OK CUTS. 

WEST BENGAL. 1949-50 



stages of sampling 

degrees of 

standard deviation of tho stago 
moans obtained from cult of radius 


i rcouoto - 

20* 

4 0* 

6'8* 

1. 

locality within stratum 

827 

1.17 

1.30 

1.25 

2. 

grids within locolity 

1885 

2.50 

2.10 

2.21 

3. 

sample-cuts within grid 

2851 

3.48 

2.90 

2.70 

4. 

total between cuts 

5777 

4.83 

4.27 

4.14 

5. 

mean in mnund* per aero 

— 

11.14 

10.50 

10.48 


Source : Mahalanobis. P. C. nnd Scngupto, .1. M. (1901) : On tho sizo of ttamplo 
cuU in crop-culling experiment* in llio Indian Statistical Inatituto : 1949-50. Bull. Ini. 
Slot. Inti., 33(2). 359-403, T*bt- 13. 


From Tablo 4 it can bo seen that tho decrease in the standard deviation in 
increasing tho radius of the circular cuts from 2 ' to 4' is more than that achieved by 
increasing the radius from 4' to 5' 8'. Further, the mean yield rate is considerably 
higher for circular cuts of radius 2' than that for circular cuts of radii 4' and .V8". 
which agree fairly closely. Thus Mahalanobis and Scngupta (1951) showed that, 
though tho cuts of very small size possibly give rise to an over-estimate of yield, 
tho bias becomes negligible as the radius of the circular cut is increased to 4'. 

Even a brief description of Mahalanobis' work relating to the development of 
crop yield survey in India would bo incomplete without reference to tho long standing 
technical controversy, which has developed in India on the issue of the shape and 
the size of cuts to be used in crop yield surveys. After considerable experimenta¬ 
tion with cuts of different shapes and sizes. Mahalanobis recommended tho use of 
concentric circular cut of radius 4' for yield surveys and the Indian Statistical 
Institute (ISI) has been using the circular cuts in the National Sample Survey and 
other surveys.* 

•J. M. Songupta of tho ISI has porfectod an instrumout which has boon found to bo extre¬ 
mely usoful in having circular cuts with considerable operational ooso und accuracy. 

38 
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As against this the Indian Council of Agricultural Research (formerly Imperial 
( ouneil ot Agricultural Research) (ICAR) has been using the rectangular cuts of size 
10.5' in their crop yield surveys conducted through the state agency. Mahala- 
nohis has shown keen interest in resolving the technical controversy on this issue and 
has been suggesting joint studies by both the ISI and the ICAR. In this connection 
Mnhalanobis (1946b, p. 279) states in his paper on sample surveys of crop yield in 
India. 

I may mention, however, that for some considerable time I have been pressing 
on ICAR authorities the need for carrying out crop cutting work by both ISI 
and ICAR methods in the same region with a view to studying the relative effici¬ 
encies of the two systems. I have submitted definite schomos for this purpose 
which arc under consideration by the Government of India.” 

He reiterated his suggestion for joint studies during the Fifth Session of the 
United Nations Sub-Commission on Statistical Sampling hold in Calcutta in 1951. 
Recently some joint studies arc being carried out in a phased manner to study this 
problem at the specific initiative of Mahalanobis. 

8.0. Cost function. One of the main considerations, which led Mahalanobis to 
use the grid ns the sampling unit in crop acroage surveys and a multi-stage design with 
cuts of small size ns ultimate sampling units in case of crop yield survoys, was cost. 
From the beginning he has emphasised the importance of cost studies in statistical 
surveys and has himself carried out extensivo studios to evolve suitable cost functions 
for different situations. In crop survoys, he considered the cost function to bo made 
up of four components 

(i) "enumeration” consisting of identifying the sample grids and noting 
down the proportion of area under the crop; 

(ii) "journey” comprising of all journeys for the survey; 

(iii) "miscellaneous” comprising of preliminary arrangement, copying of field 
records, attending to supervisory officers, despatch of data collected 
etc.; and 

(iv) "indirect” which is the residual category comprising recreation, sleeping, 
etc. 

As mentioned earlier he recognised that the total cost would depond on the 
grid size * and density of grid y. Further, he deducod and empirically verified that 
the expected value of the distance between n points selected at random in a region 
of A units of area would be proportional to 




(19) 


Taking cost functions for the first three cost components, which directly 

relate to the survey operations as „ i9M 

E = a x +b x y t J = a t +b 2 y/y, M = ( ' 

where E , J and M are the cost (or time) per square mile, the total cost (or time) o 

field work can be written as 

w = A + By/y + Cy, - W 
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where w is the total cost (or time) per square mile and A, D and C are constants, 
which dopond on the grid size and density of grids. The cost of field work for different 
values of grid size and density of grids per square milo, based on studies conducted 
during the sample survey of juto crop in Bengal in 1041, is shown in Table r». 

TABLE 5. COST OF FIELD WORK IN PAY-HOURS PER 100 SQUARE MILES 

FOR DIFFERENT GRID SIZ ES AND DENSITIES OF GRIDS _ 

density of grids per square milo 


grid si/o 
in acres 

1.65 

1.32 

1.10 

.88 

.00 

.33 

.11 

.05 

(1) 

(2) 

(3) 

(4) 

(S) 

(0) 

(7) 

(8) 

(9) 

1.0 

1317 

1125 

990 

850 

703 

459 

250 

180 

2.0 

1351 

1152 

1013 

809 

717 

400 

259 

181 

2.5 

1380 

1180 

1030 

887 

731 

472 

201 

182 

3.0 

1431 

1210 

1000 

911 

748 

482 

204 

184 

4.0 

1504 

1323 

1155 

082 

802 

509 

273 

188 

0.0 

1070 

1047 

1420 

1199 

964 

590 

300 

200 

9.0 

2950 

2431 

2079 

1721 

1350 

7S0 

305 

230 


Source : Mnhnlnnobis, P. C. (1942c) : Goneral report on th® sample census of tho nron under juto 
in Bengal, 1941. Submitted to tho Indian Contra! Juto Committoo. 

From this table it can be soon that the reduction of cost in decreasing grid 
size from 9 acres to 0 acres or 4 acros is substantial, whereas reduction in cost becomes 
marginal for decreases in grid size below 4 acres. Further, from Table 0, giving the 
cost per square mile for different levels of error and grid sizes, it is cloar that the opti¬ 
mum grid size is 4 acres. 

TABLE 6. COST PER SQUARE MILK FOR DIFFERENT LEVELS OF ERROR AND SIZE 

OF SAMPLE UNIT 


cost in rupee* per square milo 


coofliciont 
of error 

100 ‘/vlpq 

fit 

random plot 

fOI 



grids of sizo 



1 aero 

4 acros 

lit 

9 acros 

10 acres 

30 ncrcs 

\ 1 J 

100 

1.90 

1*1 

1.32 

w 

1.22 

(5) 

1.24 

(6) 

1.25 

(7) 

1.30 

90 

1.94 

1.38 

1.29 

1.30 

1.33 

1.45 

80 

2.01 

1.47 

1.37 

1.40 

1.43 

1.59 

70 

2.10 

1.59 

1.49 

1.53 

1.67 

1.78 

60 

2.22 

1.77 

1.67 

1.74 

1.80 

2.07 

50 

2.41 

2.00 

1.97 

2.06 

2.16 

2.54 

40 

2.73 

2.58 

2.49 

2.65 

2.81 

3.41 

30 

3.38 

3.66 

3.59 

3.90 

4.19 

5.25 

20 

5.08 

6.61 

6.64 

7.37 

8.00 

10.45 


Source : Maholonobis, P. C. (1940c); Report on tho sample census of juto in 1939. Submittod 
to tho Indian Control Juto Committoo. 
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It is to be noted that Mahalanobis considered the cost of statistical operations 
as important as the field cost and took into account both field and tabulation costs 
in arriving at optimum grid size and density of grids. An illustration of the details 
to which the statistical cost was considered by him is provided by Table 7 giving the 
time requirements for statistical work in a crop acreage survey. In Table 8, the 
observed and graduated values of time required for statistical work are given, whore 
the graduation is done on the basis of the time function 

t = a+by+exy, ... ( 22 ) 

where x is the grid size and y is the density and a, b, and c are constants. 


TABLE 7. TIME REQUIREMENTS FOR STATISTICAL WORK 


(A) preliminary work in man-hours por square mile 

(1) arranging maps ; preparing sheet list* etc. 0.1997 

(2) distribution of grid* by half-sample* 0.1391 

0.3388 


(B) work independent of aixe of grid* in man hour* por 100 grid* 


(1) 

loeating and marking aomplo unit* 

3.17 

(2) 

clan*ideation and tabulation of ‘klia*rn«' 

1.81 

(3) 

calculating avorago and atandard orror* 

3.19 

(4) 

comparing half-aample* ; varianeo calculation* 

2.70 

(5) 

tabulation and analyai* of timo record* 

5.83 

(6) 

cost analyai* 

8.11 


24.87 


(C) work depending on aizo of grid* in man hour* por 100 gird* 


sorml namo ol item 
no. 

1 

2.25 

4 

0.25 

9 

10 

0 (1) 

(2) 

(3) 

(4) 

(ft) 

(C) 

(7) 

1. preparing list of plots 
with chocking 

10.30 

11.52 

19.35 

20.44 

28.92 

42.03 

2. preparing •khanra*’ for 
Field Branch 


7 00 

7.39 

9.42 

11.22 

13.00 

3.74 





3. area extraction 

(jute plot* only) 

7.15 

12.03 

15.23 

22.92 

20.72 

74.05 

4. anna conversion and 
grid totalling 

2.21 

3.83 

oi; m 

4.14 

4G 11 

0.87 

05.05 

8.17 

75.03 

11.29 

140.43 

5. total variable position 

0. total non-variable position 

23.40 

24.87 

24.87 

24.87 

24.87 

24.87 

24.87 


7 total man-hours 
per 100 grid* 


48.33 


59.91 70.98 90.52 99.90 105.30 


p r iiOill- Report on the aamplo census ofthoaroa 

rr. —- - - —■— - “• 
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TABLE 8. GRADUATION OF TIME REQUIRED FOR STATISTICAL WORK 
MANHOURS TER 100 GRIDS _ 


•ix© of grid 

number of 

time for 

statistical work 

dilTemnro 
observed - 

percentage 

difTerenco 

in ncro 

grid* 

ohaorved 

graduated 

graduated 


(1) 

(2) 

(3) 

(4) 


(0) 

1 .00 

2.25 

4.00 

0.25 

9.00 

16.00 

1766 

2587 

32990 

1804 

2192 

100 

' r-«Noo 
fieoiooo 

50.83 

59.28 

70.91 

85.90 

104.37 

151.21 

-2.50 
+ 0.71 
+ 0.07 
+ 4.50 
-4.47 
+ 14 09 

-4.9 
+ 1.2 
+ 0.1 
+ 6.3 
-4.3 
+ 9.3 

e • i . ... 


Source : Mahalanobia. P. C. (1941) : Report on the sample eon.u- of tho nron 
under juto in Bongal in 1940. Submitted to tho Indian Control Job* Committoo. 


4. Assessment and control of errors 

4.1. Errors in surveys. Tho most important contribution of Mahalanobis to 
tho field of statistics in general and to sample surveys in particular, which he 
himself considered to bo of considerable value, is tho development of the techniques 
for assessing and controlling errors in censuses and surveys. He was perhaps tho 
first person to roaliso fully the implications of sampling and non-sampling orrors in 
statistical surveys. Tho theory of sampling, developed till 1930. related mainly to 
tho study of sampling orrors. Ho has considered the total margin of errors in tho 
results of a sample survey to consist of tho throe components : 

(i) sampling error arising duo to variation from sample to sample; 

(ii) error due to physical fluctuations in observation, measurement and tabu¬ 
lation; and 

(iii) mistakes such as deliberate wrong recording of the data. 

Differentiating tho components (ii) and (iii). Mahalanobis (1945. p. 37) states : 

"...mistakes or false entries are more dangerous as they aro not amenable 

to statistical treatment. Special precautions have to be taken and suitable 
statistical checks and controls have to bo incorporated in tho design of the survey 
to dotect (and hence to discourage) such dishonest work.” 

It is proposed to consider briefly, giving illustrations, tho following techniques 
of assessing orrors in surveys, which have boon proposed and developed by 
Mahalanobis : 

(i) interpenetrating (not work of) sub-samplos; 

(ii) duplicated samples; 

(iii) use of variance function; and 

(iv) inspection, scrutiny and verification. 

It may be pointed out that Mahalanobis has always emphasized the need 
for controlling sampling and non-sampling errors rather than their complete elimi¬ 
nation, since reduction of errors beyond a cortain stage may be not only costly but 
also unnecessary as long as the margin of error in the estimate is within what he 
has termed permissible error for tho purpose in view. 
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4.2. Inter penetrating sub-samples. Since 1036 Mahalanobis has been using 
the technique of interpenetrating (net work of) sub-sample in assessing and con¬ 
trolling the errors in surveys. This techniquo. in its general form, consists in 
drawing the sample in the form of two or more sub-samples so as to bo ablo to 
got a valid estimate of the population parameter under consideration on the basis 
of each sub-sample and arranging to get the work of data collection and tabula¬ 
tion for these sub-sample dono by different parties of investigators and com¬ 
puters. This procedure helps in analysing the total variation in the results into 
its components, namely, sampling error, ascertainment error and tabulation error. 
Variation between k sub-sample estimates provides an idea of the total margin 
of error of the estimate including both sampling and non-sampling errors. In fact, 
in caso of estimators for which the usual variance estimator is rather complicated, the 
estimate of variance based on the sub-sample estimates is the simplest way of getting 
an idea of the total margin of error. Further, minimum and maximum estimates 
based on the k sub-samples provides a confidence interval for the modian (and the moan, 
in case of a symmetric distribution) of the estimator with a confidence coefficient of 

Discussing the question of assessment of errors in surveys, Mahalanobis 
(1945, p. 37) describes tho techniquo of interpenetrating sub-samples as follows: 

"Ono type of control has proved extremely useful in Bengal. Tho total 
number of grids in each zone is divided into equal portions say (A) and (B). The 
grids alloted to sub-samplo (A) are scattered at random all over tho zone; and, in 
the same way, the grids allotted to sub-samplo (B) aro also scattered over tho 
whole area; the two sub-samples (A) and (B) arc thus completely mixed up and 
inter-penetrate into one another. The information on tho two sub-samples is 
collected by two entirely different sets of field investigators who work indepen¬ 
dently and at different times in the same zone so that they never meet. How far 
they are in agreement immediately furnishes a good idea about tho reliability (or 
otherwise) of the results." 


This technique can well be applied to bring out the variation between investi¬ 
gators, methods of data collection, tabulation procedures and variation over time. 
Mahalanobis has used linked sub-samples to study the differential bias of investigators, 
as it would increase the precision of comparison of estimates supplied by different 
investigators. In the exploratory surveys, linked pairs of grids wore located on the 
maps in the form of dumb-bell shaped figures, one end of each figure represented the 
grid belonging to sub-sample 1 and tho other end belonging to sub-sample 2. 
The two sub-samples were surveyed by two different sets of investigators independently. 

The technique of interpenetrating sub-samples may bo used as a broad chock 
on the different operations involved in a large-scale sample survey. For instance, 
if estimates based on k different sub-samples surveyed and tabula ted by &*"«*"* 
of investigators and computers agree fairly closely, it can bo safely assumedhat the 
survev operations have been under statistical control. However, it may be noted that 
if there is some systematic error which is common to the different sots of invest,gators 
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and computers, it would not bo shown up by this procedure. On the other hand, if 
one of those estimates differs substantially from the other k — 1 estimates, it is clear that 
this sub-sample estimate is unreliable and hone© it is necessary to check up the primary 
data and verify the calculations for that sub-saraple, on which this particular estimato 
is based. Thus it is seen that it is possible to take corrective action on the basis of the 
sub-sample estimates, thereby increasing the accuracy and the utility of the final 
results. 


The results of the Bengal Crop Survey carried out in tho form of two indepen¬ 
dent sub-samples by two sets of investigators (say, A and B) arc given in Tabic 9. 
From this table it may be noted that there is very good agreement botwcon tho sub- 
sample results. 


TABLE 9. BENGAL CROP SURVEY (1943 45): HALF-SAMPLE COMPARISONS 


yoor 

number of grid* surveyed 

area under crops in 
thousand acrca 

difTcronco 

(AB) 

at on- 
dnrd 

Fishor'a / 

•nmnlo 

(A) 

sample 

(B) 

combined 

•muple 

(A) 

Mtmplo 

(B) 

combined 

actual porcentngo of 
diffo* 
ronco 

0) 

(2) 

(3) 

(4) 

w 

(6) 

<7) 

(8) (9) 

(10) 

(II) 





jute crop 





1943 

29.676 

29,676 

59,352 

2,759 

2,757 

2.758 

2 0.1 

100 

0.02 

1944 

30.487 

30,037 

60,524 

2,150 

2,056 

2,106 

9* 4.4 

50 

1.87 

1015 

53,504 

52,623 

106,127 

2,512 

2,528 

2,520 

-16 -0.8 

• 

• 





out (monsoon) rice 




1943 

20,676 

29,676 

59.352 

6.807 

6,923 

6,865 

-116 -1.7 

446 

0.20 

1014 

30,487 

30,037 

60,524 

7.815 

7,942 

7.873 

-127 -1.6 

00 

1.41 

1015 

53,501 

52,623 

106.127 

6.966 

6.805 

6.864 

161 2.3 

• 

• 





ainan 

(teinler) rice 




1043 

31,216 

31,215 

62,431 

23.840 

24,044 

23.942 

-204 -0.8 

703 

0.29 

1944 

50.501 

50.107 

100,608 

22.491 

21,903 

22,201 

588 2.7 

550 

1.07 

1945 

46,148 

45,071 

92,110 

20,970 

21.202 

21,087 

-232 -1.1 

103 

2.26t 


•not ovniloblo; fsignificant at 5 por coni lovel. 

Source: Mahalanobis. P. C. (1946a): Rocont experiments in statistical sampling in tho Indian 
Statistical Institute. J. Roy. Slat. Soc., 109. 326 378, Table 2. 


Another illustration of tho uso of the technique of intorponetrating sub- 
samplos for estimating tho total margin of error is given by the Bengal Labour Enquiry 
(Mahalanobis, 1946a), whore the field work was carried out in tho form of a Latin square 
arrangement with five blocks (groups of houses) and five investigators. Hero the esti¬ 
mator for cost of liv.ng index, for which the usual variance estimator is quite compli¬ 
cated, .s considered and tho standard error of this estimator is calculated on tho basis of 
tho sub-sample results. Relevant information regarding this survey is given in 
Table 10. 
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TABLE 10. BENGAL LABOUR ENQUIRY-JAOADDAL : COST OF LIVING INDEX FOR 1942 
AND 194.', WITH 1941 AS BASE BY BLOCKS AND INVESTIGATORS 


KlAnlra 



investigators 




total 

DIOCKS 

1 

2 

3 

4 

5 

size of 
samplo in 

mean index 
with standard 
error 

(0) 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 




1942 cost of living indox 




l 

120(33) 

122(33) 

122(33) 

124(31) 

124(27) 

157 

122 ± 0.67 

2 

122(30) 

120(30) 

121(31) 

124(31) 

118(34) 

168 

121 ± 1.88 

3 

121(37) 

123(30) 

121(45) 

121(29) 

121(29) 

181 

121 ± 0.36 

4 

110(20) 

122(18) 

120(20) 

123(23) 

121(18) 

99 

121 ± 0.05 

5 

121( 7) 

124( 9) 

124( 8) 

124( 6) 

124( 7) 

37 

123 + 0.53 

1941 

(133) 

(132) 

(137) 

(125) 

(115) 

042 

— 

moan index 121 ±0.40 

122 ± 0.57 

121 ± 0.41 

123 ± 0.41 

121 ± 1.04 

— 

122 ± 0.33 




1945 cost of living indox 




1 

270(33) 

280(33) 

275(33) 

271(31) 

279(27) 

157 

270 ± 2.0 

2 

203(30) 

205(36) 

284(31) 

209(31) 

207(34) 

108 

200 ± 3.6 

3 

204(37) 

274(36) 

278(45) 

272(34) 

269(29) 

181 

272 ± 2.4 

4 

203(20) 

274(18) 

271(20) 

297(23) 

263(18) 

99 

275 ± 0.2 

5 

2G0( 7) 

270( 0) 

206( 8) 

274( 0) 

284( 7) 

37 

270 ± 0.2 

(1041) (133) 

moan indox205 ±1.38 

(132) 

273 ± 2.56 

(137) 

279 ± 2.09 

(125) 

276 ± 4.57 

(115) 

271 ± 2.87 

642 

273 ±1.04 


Numbor of samplo forailios ii givon within brnckots. 

.Source : Maholonobis, P. C. (1940.) : Recent experiment, in .tMurt.cl «,mpl,ng m 
Statistical Institute. J. Itoy. Slat. Soc., 109. 320-378. Table 10. 


tho 


Indian 


The results of the enquiry into the tea drinking habits of middle class Ind.an 
families in Calcutta (Mahalanobis, 1943). where tho sample, selected m tho form 
interpenetrating sub-samples was surveyed by two sots of invest,gators, are g.von 
in Table 11. 

TABLE ... COMPARISON OK RESULTS O.VEN BY TWO PARTIES OK ,NVEST.OATORS 


ostironto by party ±s.o. 


porcontngo of 


difforonco-J;s.o. 


( 1 ) 


( 2 ) 


(3) 


( 4 ) 


1. familios taking tea 

2. persons taking tea among families taking f 

3 . persons taking tea among all families 


07.82 ± 180 
00.15 ± 197 
43.00 ± 1.51 


08.21 ± 2.08 
02.34 ± 1.12 
41 .03 ± 2.10 


— 0.39 ±3.20 

— 2.19 ±2.27 
+ 1 .97±2.50 


TiOII' 'ueii-B -- " _____— . ,. 

o, ariaklaa .» — 

^ estimates by - 
parties of investigators A and B is not statically s.gmficant. 


SAMPLE SURVEY THEORY AND METHODS 

In the National Sample Survey (NSS) the sample is usually selected in the form 
of 4 or more sub-samples, half of which are surveyed by the central agency and the 
other half by the State agency and within each agency half the number of sub-samp os 
are surveyed by one party of investigators and tho other half by another party o 
investigators. The data collected arc also tabulated separately by sub-samples by 
the two agencies. Since two or three years the sub-samples allotted to the central 
agency are also being tabulated independently in different tabulation centres at the 
instance of Mahalanobis. 

In tho 8th round of the NSS, conducted during 1954-55, the central and the 
State agencies surveyed 4 and 8 sub-samples respectively for tho land holdings 
enquiry. Tho design of the survey was a stratified two-stage one with villages and 
households as first and second stage units respectively. The sub-sumplo-wisc results of 
this survoy are given in Table 12. 

The technique of interpenetrating sub-samples is also very useful in getting 
an idea of tho margin of error in the case of estimation of distributions such as con¬ 
centration curves and mapping problems. Mahalanobis (1958, 1900) proposed tho use 
of tho urea between the two estimated distributions based on tho two interpenetrating 
sub-samples as a measure of tho total margin of error in the estimated distribution 
based on the combined samplo. 

Mahalanobis recognized that the uso of tho technique of interpenetrating sub- 
samples in practice requires additional care at tho different stages of the survey and 
that the cost of tho survey may also incrcaso to some extent. As regards tho cost, 
ho has pointed out that only tho journey cost in field work is likely to increase and 
t hat this additional cost, which would bo a small portion of the total cost including both 
field and tabulation costs, would be worthwhile considering the advantages of this 
tochniquo. Tho various aspects of this technique have boon discussed in detail by 
Mahalunobis (1940a, 1944, 1945, 1946a, 1958, 1960), Mahalanobis and Luhiri (1901) 
and Lahiri (1954, 1958a and 1958b). In the preface to his book, in which ho has exten¬ 
sively used tho technique of interpenetrating sub-samples for estimation of errors, 
Doming (1960) states : 

“In respect of now methods, tho chief contribution is replication by 
procedures that maintain efficiency, yet facilitate tho estimation of standard error 
and of any other errors that exist in tho estimator used. The method is essentially 
based on Mahalanobis’ interpenetrating sub-samples, which he introduced in 1936 
in his survoys in Bengal.” 

4.3. Duplicated samples. Another technique, which is commonly used to assess 
non-sampling errors is to rosurvey the sample units using better trained personnel. 
In a sense this may be considered as a particular case of tho technique of interpene¬ 
trating sub-samples, since in this case the interpenetrating sub-samples are identical 
and surveyed independently by two sets of investigators. In the exploratory stage of 
39 
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fA few small States have been omitted. 

Sourer : Mahalanobis P. C. and Lahiri D. B. (1961): Analysis of errors in censuses and surveys with special roforonco to experience in India. Bull. Ini. 
Slat. Inst.. 38(2). 401-433, and Sankhya. 23(A). 325-338. 
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the crop survey in Bengal, this method was extensively used to bring out the importance 
of non-sampling errors. This method was also used in the Bihar Crop Survey 1043-44, 
where 25 per cent of the samples was re-enumerated independently by another set of 
investigators. The results of plot by plot comparison of discrepancies for different 
types of enumeration are given in Table 13. In this table the data collected for a sample 
of mauzas (villages), grids and plots by re-enumeration arc compared among themselves 
and with a complete enumeration carried out earlier. 


TABLE 13. COMPARISON OF DISCREPANCIES IN AREA UNDER CROP FOR DIFFERENT 

TYPES OF ENUMERATION 


enumerations compared 

total area 
(acre*) 

absolute sum of 
discrepancies 

algebraic sum of 
discrepancies 

(in acres) 

percentage 

(in acres) 

percentago 

0) 

(2) 

(3) 

(4) 

CM 

10) 

‘random mnuzn* and ’complcto" 

224.61 

130.18 

57.9C 

10.70 

4.70 

‘random grid' and 'complete' 

87.28 

70.33 

80.58 

-6.93 

-7.94 

‘random plot* and 'complete' 

52.91 

28.33 

53.54 

-9.27 

-17.52 

‘random grid' and ’random mauza’ 

13.28 

5.82 

38.09 

-3.30 

-21 .99 

'random plot’ and 'random grid’ 

3.37 

1.23 

23.28 

-0.71 

-13.22 


Sourer: Mnhalanobis, P. C. (1038): A statistical report on the experiment ill crop returns, 
1937. Submitted to the Indinn Cent ml Juto Committee. 


From this table it can be seen that both the net and gross errors arc fairly 
largo for most of the comparisons, though the gross error is. in most cases, considerably 
larger than the net error. This shows that the non-sampling errors aro fairly largo 
and that proper precautions and suitablo statistical controls are necessary to reduce 
such orrors in sampling. 

4.4. Control through variance function. Another mot hod used by Malmlanobis 
in assessing and controlling errors in surveys relates to the use of the variance function. 
For instance, in the case of crop yield surveys tho variance of the estimate of yield 
rate based on sample cuts should decrease with increase in the size of the cut and this 
result is made use of in assessing the quality of field work by instructing tho investi¬ 
gators to harvest the cut in the form of sub-cuts. That is while adopting a circular 
cut of radius 5'8', tho crop within a circular cut of radius 2' is harvested first, then the 
annular portion between circular cuts of radii 2' and 4' and finally the annular portion 
between circular cuts of radii 4' and 5'8'. Discussing this type of cont rol Malmlanobis 
(1946b. p. 276) states : 

" A com P aris °n of mean values based on different sizes of cuts shows whether 
or not any bias had arisen in using different sizes of cuts in tho process of harvest- 
mg. Cuts of different sizes would, however, in general show deereasing variance 
w.th increase in size. A comparison of variances for cuts of different sizes thus 
supphes another valuable control. For example, it is sometimes found that 
mean values based on cuts of different sizes are in excellent agreement (often 
much better than one could expect from probability considerations), and variance 
of yield rates for cuts of different sizes are also about equal. I„ such cases it 
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Source : Mahalanobis. P. C. and Sengupta, J. M. (1951): On the sire of the sample cuts in crop-cutting experiments in the Indian Statistical Insti- 
tuto 1939-50. BuU. Ini. Slat. Inti., 33(2), 359-403, Table B-l. 
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is practically certain that cuts of only one size had l»ecn actually harvested 

records for cuts of other sizes were obtained by paper calculations. Multiple cuts 

of other shapes and sizes have also been used in crop-cutting work, and found 

to be quite useful." 

Table 14 giving the primary data for 12 investigators suspected of recording un¬ 
reliable information on the basis of an analysis of errors using the variance function 
approach, brings out clearly the usefulness and potentialities of this method. 

4.5. Inspection, scrutiny an/I verifiication. Mahalanobis has also attached 
considerable importance to the conventional forms of error control through inspection, 
scrutiny and verification. For instance, even in the case of such a large scale survey 
as the NSS, the ratio of inspectors to investigators is 1:4. He has emphasized the 
salutary effect that the very idea of inspection, scrutiny and verification has on the 
quality of work. He had tried out various forms of inspection such as inspection prior 
to and after data collection by investigators and accompanied inspection. He had made 
it a policy of the Institute to completely verify all computations after introduction of 
dummy mistakes to minimize the error at- tho tabulation stage. The quality of 
work of the verifiers is judged on the basis of the proportion of dummy mistakes 
they have been able to spot out. In the NSS. a two-tier scrutiny system has 
been developed, in which tho data collected are scrutinized once in the field 
offices and then again at the tabulation stage. The aim of field scrutiny is to find 
out mistakes and discrepancies which need verification in the field and which can 
possibly be rectified by further investigation whereas the scrutiny at tho tabulation 
stage aims at detection of errors which can be rectified without the need for further 
field work and at studying the general quality of the data collected with a view to 
improve upon the format of schcdulos. instructions and methods of data collection 
in future surveys. 


5. Organization of i.aroe-scai.f. sampi.e surveys 

5.1. Bengal crop survey. As has been pointed out earlier, the main difference 
between the development of sample survey methods in India by Mahalanobis and in 
other countries has been the scale of operations with which the theory of sampling has 
been applied to practical problems. Starting with exploratory surveys confined to 
an area of a few square miles in Bengal in 1937, Mahalanobis was perhaps tho first 
person to organize and carry out an objectively designed large scale sample survey 
covering the wholo of Bengal (about 53,000 square miles) in 1941. The magnitude of the 
scale of operations and the difficulties involved in organising the jute acreage survey 
in Bengal in 1941 can easily be imagined if we note that a total of about 102000 sheets 
of maps covering about 50,000 square miles had to be collected and used for selecting 
about 58,000 sample units (grids) after suitable stratification and that a staff of about 
350 field investigators and about tho same number of statistical workers were employed 
in this project. As mentioned earlier, Mahalanobis has termed tho task of organizing 
and carrying out such largo scale surveys as statistical engineering. 
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A comprehensive description of the stages of work involved in the Bengal 
jute survey plan, as given by Mahalanobis (1940a. p. 512), is as follows : 

“In this plan the whole of the area to be surveyed (in this case roughly 
55.000 square miles) will be divided into a number of zones of suitable size. The 
size of each zone need not be exactly the same, but it is desirable that each zone 
should be as homogeneous as possible in regard to the intensity of cultivation, 
that is, the proportion of land under jute. A number of points’ are then selected 
strictly at random within each zone. At each of these points a sampling unit 
(which may conveniently be called a ‘grid’) of a suitable size, of the order of say 1, 

4, 16 or 40 acres, is surveyed in detail. In this way the proportion under jute in 
each grid can be determined. If we have a large number of grids in each zone, 
the average proportion calculated from the grids within the zono can be taken 
to be the representative figure of the zono. Multiplying by the total area of each 
zone (which is known) it is then possible to estimate the area under jute in each 
zono. Adding the figures for the different zones, the total area under jute in 
each district or in the whole province can be then easily obtained.” 

5.2. Exploratory studies. Recognizing fully the difficulties in organizing and 
carrying out large scale sample surveys, Mahalanobis has been strongly advocating the 
need for exploratory and pilot studies before taking up a large scale survey. During the 
exploratory stage, studies can bo carried out to evolve suitable sample design taking 
into account both variance and cost aspects and to evolve suitable fiold and statistical 
organisations. As has been mentioned earlier, the Bengal crop survey was taken 
up in a phased manner since 1937 which helped in carrying out the sample survey on a 
large scale covering whole of Bengal in 1941. The experience gained in the Bengal 
Crop Survey was of considerable help in organizing and conducting efficiently the 
crop survey in Bihar in 1943-44. 

5.3. Large scale surveys. In organising largo scale sample surveys, Mahalanobis 
has laid considerable emphasis on tho proper training of the field and statistical 
personnel in the survey work and on assessing and controlling errors at different stages 
of the survey by using suitable statistical techniques. In large scale surveys, he 
recognised fully tho need for designing the survey in such a manner as to maximize 
the information content per unit of cost. Ho has pointed out that the absolute marg.n 
of error in survey results is not important in itself and that results with margins of 
error less than what may be termed permissible errors should be considered 


satisfactory. 

5 4 National Sample Survey. Mahalanobis - organisation of tho National 
Sample Survey in 1950, which is perhaps the largest survey organiso.l in any country, 
may be considered to be one of his major achievements in tho field of statist.es and this 
undoubtedly has been made possible because of the considerable expenonce ho had 
gained in his earlier surveys in Bengal and Bihar. The NSS, in the first round of winch 
about 1800 villages were surveyed by about 350 investigators, has gradually expanded 
^ a sample survey covering about .7.000 sample viU^a and 90.00 sample u^n 
blocks canvassed by the centra, and state agencies together havmg a total of about 



311 


SAMPLE SURVEY THEORY AND METHODS 

1,400 field investigators. Mahalanobis, who was instrumental in organizing this 
survey, has been its guiding spirit during tho last 13 years of its existence. 

Apart from the technical problems involved in designing and carrying out 
a large scale sample survey, there are formidable administrative problems to ho 
oxcountorod in recruiting, training and supervising a largo staff for doing the field 
and statistical work in such surveys. Mahalanobis has tried out different methods of 
measuring the output of primary workers and of assessing tho quality of their output. 
Discussing the question of measurement of output of workers, Mahalanobis (1944, 
p. 410) stated : 

“The average output of all workers for any particular ty|»o of work was 
adopted as tho basis of comparison, and the indox of output for each individual 
was found by dividing this actual output by tho adopted standard and 
multiplying by 100 ." 

It is of interest to note that oven as oarly as 1937, Mahalanobis realisod tho 
need for caroful planning in designing a sample survey, when ho (1937) states : 

"Very caroful preparation is nocossary to draw up an adoquato and 
satisfactory schomo of tho samplo survey. Small-scalo field experiments will also 
be needed for this purpose, besides a great deal of spade-work in the way of 
drawing up of specifications, definitions, forms and schedules and tho preparation 
of tho sampling technique and programme." 

5.5. Popularization of large scale surveys. Having foreseen tho potentialities 
of large scalo samplo surveys, Mahalanobis holped considerably in tho development of 
samplo survey theory and methods by popularizing tho random sample mothod through 
demonstration of its utility in practical problems. 

The scores of statistical survoys presently being conducted annually in India 
and tho facilities that uro now available in this country for training and research in 
samplo survoys stand testimony to the extent of Mahalanobis’ success in propagating 
tho idea of using properly designed sample survoys to moot tho growing needs for 
statistical data to be used in planning for national development and for other purposes. 

It will not bo out of place to give hero two important illustrations of how 
Mahalanobis proceeded about popularising large scale samplo surveys by actual demons¬ 
tration of its usefulness. 

At the request of the Indian Central Jute Committee, Mahalanobis prepared 
a scheme in 1936 for a sample survey of jute crop in Bengal which envisaged a gradual 
expansion of the surveys with a view to having a largo scale sample survey in 1941 
covering the whole of Bengal. Tho Jute Census Committee laid down tlueo tests 
for the success of tho schemo : 

(i) the margin of error of area under jute should not exceed 5 % ; 

<ii) the results must be available by the first week or second week of September- 
and r * 

(iii) tho cost of samplo survey should not be excessive. 
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Mahalanobis amply demonstrated that it was possible to successfully meet these 
tests laid down by the Jute Census Committee by carrying out the sample survey 
of jute crop in Bengal such that 

(i) margin of error was only 2.8%, well below the stipulated 5% margin; 

(ii) the results were made available on the 27th of August, well ahead of the 
target date; and 

(iii) the cost of the sample survey was Rs. 1.14 lakhs which compared 
very favourably with the cost of Rs. 15 lakhs for a complete enumeration. 

This success of Mahalanobis is of considerable importance, as this demonstration 
of the usefulness of the method of random sampling went a long way, especially in 
India, in popularizing this method. 

Another demonstration relates to the comparison of the results of a well designed 
sample survey of jute crop in Bongal conducted under Mahalanobis’ guidanco and 
direction and those of a complete enumeration conducted by the official agoncy with 
the very reliable trade figures which became available subsequently. Relevant infor¬ 
mation is given in Table 15. 

TABLE 15. COMPARISON OF OFFICIAL (COMPLETE ENUMERATION) 

AND SAMPLE SURVEY ESTIMATES OF JUTE PRODUCTION 
WITH TRADE FIGURES. BENGAL 1944 45 AND 1945 40 


quantity (thousand baton) 


sorinl no. aourco 

1944-45 

1945 40 


(I) 

(2) 

(3) 

1 

trade figures (adjusted) > 

0728 

7502 

2 

complete ©numeration (official forecast) 4895 

0304 

3 

.sample survoy (estimates) 

— 

— 

3.1 

nub-sample 1* 

0830 

7734 

3.2 

Hub-sainplo 2 * 

0518 

7773 

3.3 

full samplo 

0080 

7767 

4 

discrepancy of (2) on (1) 

-27.2% 

-10.0% 

5.1 

discrepancy of (3.1) on (1) 

+ 1.0% 

+ 2.3% 

5-2 

discrepancy of (3.2) on (1) 

“3.1% 

+ 2.8% 

5.3 

discrepancy of (3.3) on (1) 

-0.0% 

+ 2.0% 


.For consumption in v.LUgc, consumed out of Inst your’, stock and julo 
crop in other provinces. 

r.Sub-samplo estimates of production ...vo been obtained by 

sub-sample estimates of crop-.cro.go by . 1.0 full sample y.old rate, at 
ETt- (sub-sampto estimate, of yield rates being no. eas.ly 

available now). 

Soar™ : M.balanobis, P. C. and Labiri. D. It. (.901): Analysis of orron. 
in ce.isusos and surveys with special reference 

But,. In,. Star. In,,.. 38(2). -101-433 and Sank***. 23(A). 32o-3o8. 
Table 1. 
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These are some typical examples illustrating Mahalanobis* methods of demons¬ 
tration of the usefulness of large-scale sample surveys using tho random sampling method 
over the methods of complete enumeration and purposive sampling. Ho has made 
extensive use of these and other successful demonstrations to drivo homo tho utility of 
this method to the people concerned. 

5.6. Multi-subject surveys. After considerable experimentation with large 
scale surveys, Mahalanobis is of the view that it is desirable to carry out multi¬ 
subject surveys in an integrated maimer with whole-time staff, as this would load to 
considerable economy of resources and operational convenience. An oxamplo of such 
a survey is the National Sample Surveys which has boon organised under Mahalanobis 
guidance and direction. A detailed account of tho need for and tho advantages of multi¬ 
subject surveys, strongly advocated by Mahalanobis, is given by Laliiri (11)03). 

6. Bibliographical note 

A brief review of tho developments in sampling theory prior to 1930 has been 
given in Section 2 to serve as a background to the work of Mahalanobis. In this 
Section it is proposed to givo a brief account of the relevant developments in this 
field since 1930 to help in appreciating Mahalanobis’ contribution to tho sampling theory 
in its proper perspective. In fact, a comprehensive reviow of tho contemi>orary deve¬ 
lopments has been given by Mahalanobis (1944) in the bibliographical note on his paper 
“On Large Scalo Sample Surveys." 

Ncyman (1934) discussed tho theoretical and practical importance of random 
sampling. He considered, among other things, selection of units and clusters of units, 
and the question of optimum allocation in stratified sampling when the total sample 
size is fixod. Sukhatmo (1935) discussed the implications of allocating tho sample size 
to the different strata on tho basis of their estimated variance. While Ncyman consi¬ 
dered the selection of exclusive clusters, Mahalanobis (1940a, 1944) considered the ques¬ 
tion of selection of overlapping clusters (grids). Furthor, Mahalanobis considered 
tho question of optimum allocation taking into account the cost aspect, whereas 
Ncyman did not consider the cost clement explicitly. 

Yates and Zacopany (1935) havo givon a comprehensive review of the methods 
used in the estimation of crop yiold in the United Kingdom. They have discussed tho 
use of multi-stage sampUng which has been used by Mahalanobis in his crop yield 
estimation surveys in Bengal. Irwin (1938). who has done pioneering work in 
tho fiold of crop estimation, has discussed different sampling methods that were then 
being used. Smith (1938) has discussed some empirical studies on the basis of 
which ho had suggested a form for tho variance function in crop surveys, which is 
similar to that proposed by Mahalanobis. Cochran (1939) has considered the different 
sampling methods that are used in crop yield estimation surveys and has discussed 
multi-stage and multi-phase sampling, which had been developed in tho United States. 

Tho regression method of estimation, used by Mahalanobis in crop yiold surveys 
and estimation of cinchona bark in 1940, was considered later in detail by Cochran 
(1942). Systematic sampling and sampling with probability proportional to size 
40 
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used or considered by Mahalanobis as early as 1937. were later discussed in detail by 
Madow and Madow (1944) and Hansen and Hurwitz (1943) respectively. 

From what has been said in previous sections it is clear that the technique 
of planning and execution of large scale surveys has mainly been evolved by 
Mahalanobis, who has considered this work to be a specialized job and termed it 
Statistical Engineering. In fact, Mahalanobis has not only proposed many of the 
methods which are being commonly used at present in the field of sample surveys 
but also demonstrated their usefulness by trying them out in largo scale surveys. 
Some of these methods, as has been pointed out in this brief review, have been 
independently proposed by other authors in tho U.K. and the U.S.A., but it may 
be noted that the sampling methods in these and other countries have been tried 
out only in comparatively small scale experiments. 

7. Conclusions 

As mentioned at tho outset, the work of Professor Mahalanobis in the field 
of sample surveys is so varied and fundamental in nature that this review is to be consi¬ 
dered as only indicative of tho tremendous developments he has brought about in tho 
field of sample surveys. Though an attempt has been made to cover all his important 
contributions, it is quito possible that this roviow is still incomplete. Besides his 
valuable personal contributions to sample surveys, he has been instrumental in deve¬ 
loping research work in this field in India in general and in the Indian .Statistical 
Institute in particular. With his guidance and encouragement, considerable work has 
been done in this field by the research workers of the Institute during tho last three 
decades. 
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SOME NOTES ON SQC 


By ELUS R. OTT 
Rutgers University, New Jersey, U.8.A. 

The national development of any modern management technology including 
Statistical Quality Control (SQC) requires at least two major stages: first, the accep¬ 
tance of the concept that the technology can become appropriately applicable to the 
needs of the nation; the originator of this idea in India was Professor P. C. Mahalanobis. 
Second, the establishment of an organization to implement the idea; such authori¬ 
zation was given him by tho Government of India and implemented through the 
personnel of the Indian Statistical Institute. 

Tho national development of SQC requires an approach on different fronts 
simultaneously: management awareness must be developed; successful industrial pro¬ 
grammes must be made available as exhibits: professional leaders must be developed; 
and a multitude of SQC practitioners given effective training and experience through 
a sequence of steps. It is an established fact that the practice of SQC in India has 
continued to improve and expand into new industries and more and more plants. 
These different fronts have been developed primarily through a unique group of 
young Indian SQC professionals now assigned to SQC Units in eight major industrial 
centers of India. They have been developed gradually over the Inst ten years and 
provido vital services in the scientific and industrial build-up of a mature, effective 
SQC structure in India. 

These SQC units continue under the administrative guidance of the Indian 
Statistical Institute to bo tho foundation for a potentially large-scale programme of 
building SQC into day-to-day operations of Indian industry. 

I. Introduction 

There are at least threo important areas of statistical activities which need 
to be distinguished : (I) statistics, (2) industrial applications of statistics, and 
(3) identification of problems in industry and science in which statistical and 
quality control techniques can be useful. 

Attention has been given to tho first two and they have produced many im¬ 
portant contributions. But the third area warrants more attention than it has received. 
It has been an interest in the third area I believe, which has led to the develop¬ 
ment of the control chart, acceptance sampling plans, narrow-limit gaging, analysis 
of moans, and designed experiments including response-surface concepts and EVOP. 
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What is the problem of a scientist, engineer, quality control practitioner, 
or industrial statistician ? 

One classification relates to the functions of the industrial practitioner : 

(1) Locate (identify) areas warranting investigation. The obvious problem 
is not always the important ono. 

(2) Plan an exploratory study including the type of data to bo collected and 
the manner of measuring and collecting it. 

(3) Collect the data, or supervise its collection. 

(4) Analyze the data. (Analysis of data is a continuing stimulus to the deve¬ 
lopment of now statistical methodology and new experimental designs). 

(5) Interpret the data, and check whether the interpretation agrees with the 
state of the science; and whether the data oven warrant a statistical analysis. 

(6) Convince appropriate personnel of the reasonableness and/or importance 
of the interpretation. (The purpose of an industrial study whether in the basic 
technology or in manufacturing is to provide a basis for action; the practitioner has 
not been successful in his task until the results of tho study have boon understood by 
those in position to make decision and authorize action). 

(7) Provide a continuing control. (It is common to identify and institute an 
improved technology, only to have it rovert to the old behaviour because of failure 
to provide a routine sampling control). 

Tho order of these functions is not necessarily vital; in fact, sub-cycles of these 
functions should bo frequent. 

Data from a study or an experiment should provide three things : 

(1) an evaluation of the statistical significance of the factors included ; (although 
it would be expected that every factor included would bo statistically significant if 
a sufficiently largo number of degrees of freedom were available); 

(2) an evaluation of tho magnitude of the effects to permit a practical evalua¬ 
tion and comparison of tho factors; and 

(3) suggestions of now relations and ideas not included in the hypothesis of 
tho experiment, i.e. discovery. 

Many books and articles are written on statistical methods of analyzing data 
already in hand, but less attention has been devoted to methods of searching for 
important factors or important areas warranting further investigations There are 
several useful search-procedures which have proved to have wide applicability. 

(1) Shcwhart Control Charts (including various uses of runs when analyzing 
data from experimental studies). 
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(2) Banks of throe, four, and more control charts, ono above tho other. 
(This often permits comparison studies, particularly useful in tho chemical industries). 

(3) Acceptance sampling plans. 

(4) Fractional factorials experimental designs, especially with tliroo factors 
(and rarely more than 5 factors). 

(5) 2 a experiments whore areas of the industrial process aro the factors. 

(6) Analysis of Means. 

(7) Narrow-limit gaging (NL-gaging). 

(8) Evolutionary Operations. 

This paper includes a technique devolopod in tho spirit of tho preceding remarks. 
A prospocting technique described in Section II was suggested by tho industrial need 
to identify economic opportunities with a minimum of offort. The tablos wore prepared 
by consulting available tables of the binomial distribution and selecting entries giving 
approximately equal risks. 


II. pROSPECTINO 

(1) A technique to search for areas of economic potential. In many plants 
and offices, it is realized that there arc processes and operations which may conceiv¬ 
ably warrant investigations or it may bo realized that there aro so many warranting 
investigations that a thorough study is not feasible. In such cases, an appropriate 
strategy may bo to plan quick "prospecting expeditions" in these departments and 
processes with tho intent of determining whether economically important opportunities 
do exist. If the prospecting fails to produce such evidence, we pass on by; if it indi¬ 
cates a possible rich lode, then a more detailed study can bo planned. To bo industrially 
useful, any proposed prospecting technique should provide means of surveying sevoral 
possibilities quickly and easily. 

Wo will prosont here a prospecting technique using small samples and sequences 
of small samples of enumeration or attribute data. Whilo it is recognized that small 
samples of enumeration data will not usually detect small differences, thoy aro ade¬ 
quate to indicate tho presence of large deviations from expected or desired performance. 
For example, a sample of n = 5 is more than adequate to tost whether tho officioncy 
of an operation (or tho quality of a lot) is at least as good as 80%. If tho quality 
is in fact 80% satisfactory (q' = 80%), the probability of finding all 6 items* un¬ 
satisfactory in a sample of 5 is : 

P{5} = (.20)* = .00032. 


•An "item” may bo an observation to determine whother a machine is in use, or it may bo on ordi 
nary tost to dotormiuo whothor a unit of production conforms to specifications. 
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Consequently, a sampling plan 

n = 5, c = 4 

which will accept the hypothesis that p' = 80% unless all items are unsatisfactory 
is conservatively adequate. 

In fact, the probability of finding 0 or 1 satisfactory in a sample of 5 whon 

q' - 80 % is : 

P{ 0, 1} — P{0}+P{1} = .00032+5(.20) 4 (.80) = .00672. 

Similarly, P{ 0, 1, 2} = .05792 = .0581. 

Thus, a sampling plan allowing as many as 2 defectives, i.o., n = 5, c = 2 (where c is 
the number of defective or unsatisfactory items) would ; 

(1) have a probability of only .058 of rejecting a process (or product) which is 
80% satisfactory, and 

(2) would have a probability less than .058 of rejecting a process with q' > 80%. 
Samples of 5 have been found adequate to detect processes loss effective than 80%. 

In this note, wc shall emphasize prospecting for satisfactory performance and 
will refer to the procedure of rejecting the hypothesis that q' > 80% if wo find no more 
than s = n—c— 1 satisfactory items; i.o., if wo find < 8, wo will rojoct q' > 80%. 
Thus the plan n = 5, c = 2 will be represented as : 

n = 6, a < 2 . 

Various prospecting criteria are presented below for n =» 10, and 20 
to use in prospecting for conditions representing potential economic gain. The 
columns labelled (1/1), (2/2), (3/3), or (x/k) indicate criteria to bo mot by a: of the k 
samples (of n each). Criteria for x < k have not beon included because they aro not 
considered useful enough. However, while information from one sample may not 
bo adequate to indicate the rejection of the hypothesis, the information from two or 
three samples will allow better discrimination, as expected. Certain OC-curvos aro 
included in Figures 1 and 2. 



U„: q’> 60 % 

n r. 10,5 < 2 (1/1) 
n - 10,5 < 3 (2/2) 
n = 10, 5 < 4 (3/3) 



(1/1) :n - 20,5 < C 
(2/2) : n - 20, 5 < 8 
(3/3) : n - 20, S < 9 
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Entries in Tables 1 and 2 have been chosen to provide, as closely as possible, 
risks* of a = .05 and a = .10 of rejecting the selected level of process quality. Since 
these risks are not possible of exact attainment, the risks corresponding to each rejec¬ 
tion criteria have been entered besides the criteria. Entries have been obtained from 
tables of the binomial. In a few instances, two different criteria havo been included 
because the risks do not approximate the a = .05 level very closely. But it will 
become increasingly clear that this technique is intended to be one on which to make 
general inferences rather than to draw sharp conclusions. 

The prospecting technique has been used in different industrial applications, 
some of which are described in Sections 2 and 3. The value of such a technique was 
suggested by data pertaining to the quality of acetylene welds on large oil-tank 
scams which are checked by infrequent and expensive X-ray techniques. It is simi¬ 
larly applicable to make initial checks on the usage of telephones, dictaphones, desk 
calculators, inspection equipment, and other expensive equipment. 

(2) Examples of prospecting uses: (A) In an inspection department: 
Consider an incoming inspection department whero there are several inspectors. 
Besides the actual assigned inspection functions there arc other functions which 
may occupy their time and attention. Then on those occasions when tho inspection 
output must be increased, there are two possible approaches; 

(a) employ more inspectors, or 

(b) find ways of increasing tho effectiveness of the existing staff of inspectors, 
perhaps by employing more assistants or by increasing their effectiveness in other ways. 
Before deciding between (a) and (b), it may be appropriate to determine whether 
the porcent of time being devoted to tho primary inspection function by the inspectors 
is reasonable. There are many “non-primary” functions which may be occupying 
their time such as : 

(a) obtaining material to be inspected, 

(b) obtaining inspection gages or equipment, 

(c) adjusting or calibrating inspection gages, 

(d) waiting for instructions; obtaining directions from engineers, etc. 

(e) obtaining drawings from files, 

(f) personal time, and 

(g) miscellaneous. 


•My recommendation is to us® a = .10 or even o 


.20 since this is a "prospecting" study. 


41 
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When initiating a study, obtain general acceptance of some percent “attention 
to primary inspection functions” as a tentative standard; thus a minimum acceptable 
group standard might be 60%. Then with 60% as a standard, wo would like evidonce 
(with risk of perhaps .05) whether our inspectors fail to attain the accepted standard. 
If, for example, an initial study indicates that the percent of time (exclusive of company 
rest periods) being devoted by the inspection group to the inspection function (a) 
is not loss than 00 %, then a different decision might be indicated than if it wero found 
that (b) is less than 50%, with some pre-selected risk a in each case. 

(B) Standard inspection methods (product or process quality) : In some 
production processes, the product quality is very satisfactory and it is uniformly 
“conforming to standard” or it is quite unsatisfactory with much “non-conforming." 
Items produced by a punch-press are often of this typo. Then the product may be 
gaged to determine its conformance either as it comes from : 

(1) a group of presses, or 

(2) a single press. 

Example : X-ray pictures aro made of wolds from different weldors. If in 
10 X-rays, the work of ono weldor shows 5 or fewer acceptable wolds, ( < 5) thon wo 
conclude (with risk of .033) that his average work quality is not as good as 80%. See 
Table 1, Column (1/1). 


III. Prospecting criteria 

In Table 1 criteria are given to test the hypothesis that the obsorvod 
samples represent populations of chosen standard on the basis of ono sample, two 
samples, or three samplos of 10 each as follows: 


Test the hypothesis that q' > 70%; 

(1) . (1/1) : if one samplo of 10 contains 4 or less (<4) items which conform to 
standard, then we reject the hypothesis, with indicated risk .047, or; 

(2) . (2/2) : if two samples of 10 each are tested and both samples contain 
( < 5) conforming items, then wo reject the hypothesis q' > 70% with risk .023. 

(3) . (3/3) : if three samples of 10 each are tested and all 3 samples contain 
(< 6) conforming items, then wo reject the hypothesis of 70% lot-quality with ns 

.043. 

Thus, the entries in the tables indicate the eriteria for rejecting the lot-quality 
shown in the column at the left with the risk indicated in the lower r.ght 
of each entry. (The entries have been chosen so as to prov.de r.sks of approx. 

mately .05). 


In Tables 2 and 3. criteria are given for n 


20 . 
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table 1. (»-IO) 


9' 


>90% 


>80% 


> 00 % 


>50% 


> >0% 


(I/O 


<0 

<7 


(013) 

(-07) 


<5 


(.033) 


<4 


( 2 / 2 ) 


(3/3) 


<8 


(.07) 


<0 

<7 


(.015) 

( 10 ) 


<7 


(.047) 


<5 

<6 


(.023) 

(. 12 ) 


<0 


<3 


<4 


(.055) 


(.027) 


<5 


(.018) 


(.033) 


(.043) 


.049) 


<2 


<4 


(.055) 


(.« 


(.054) 


>30% 


<' 


(04G) 


<2 


(.028) 


<3 


(.050) 


<0 


(.028) 


<1 


(. 022 ) 


<2 


(.050) 


il : Lot Quality • q' 



9' 

(1/1) (2/2) 

(3/3) 

>00% 

<15 

<10 

(.043) 

(.018) 


<17 

(.034) 

>80% 

<12 

<14 

(.032) 

(.038) 


""<"is"' 

(.051) 


>70% 


<10 


( 048) 


<12 


(.052) 


<13 


(. 000 ) 


> 00 % 


<« 


(.057) 


<10 


( 00 ) 


<H 


(. 000 ) 


>50% 


<0 


(.058) 


<« 


.003) 


>40% 

<4 

(.051) 

<0 

(.002) 

<7 

(.072) 

>30% ; 

<2 

(.036) 

<4 

( 067) 

<5 

(.070) 


<9 


(.07) 


TABLE 3. (nr-20) 


9' 


(1/D 


(2/2) 

(3/3) 


>00% 

<10 

(.133) 

<17 

(10) 

<17 

(.034) 

>80% ! 

<13 

(.087) 

<14 

(.038) 

<15 

(.051) 

>70% 

<11 

MU> 

<12 

(.052) 

<13 

(.000) 

> co% 

<9 

(-128) 

<10 

(.060) 

<11 

(.000) 

>50% 

<7 

(131) 

<8 

(.064) 

<9 

(.070) 

>40% 

<5 

(.126) 

<0 

(.062) 

<7 

(.072) 

>30% 

<3 

(-107) 

<4 

(.057) 

<5 

(.072) 
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Conclusion 

1 here are many vital ways in which statistical methods can be applied to the 
problems of industry as outlined in Section I. The particular technique of “Pros¬ 
pecting is presented as a method developed to help an engineer or production manager 
identify his problem. There is a need for other statistical techniques inspired by 
scientists and technologists. 
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INTERNATIONAL ASPECTS OF QUALITY CONTROL ACTIVITY 

By W. R. PABKT 

Bureau of Naval Weapons, Navy Department, Washington 
1. Introduction 

The transfer of technology among the nations of the world is one of the 
greatest challenges of our generation. Through a development of science and techno¬ 
log)’, we have found that we can produce a surplus of the things wc need; the houses, 
the automobiles, the roads, the schools, the books, the music, and the other tangible 
things that make for a better material and spiritual life. Our problems are not so 
much of production but rather of sharing this abundance among ourselves, with 
each other, giving everyone of us a stake in our national effort and endeavour. We 
in the United States have learned that the secret of a better life is to produce 
more for everyone; not keep the other fellow down, but to let the other fellow 
worker, the teacher, the middle class, share in the growing abundance. The continued 
abundance that our new technology affords is the secret weapon of our generation. 
The problem to which we must address ourselves today is how the techniques of 
quality control can be utilized in helping to spread this secret to the other nations 
of the world so that they can learn to help themselves to a fuller life. 

2. Quality control: a way of hklpino others help themselves 

The object of our international sharing is not so much the giving of supplies, 
or funds, to under-developed nations, or the taxing of our people so that free handouts 
may be made elsewhere in the world. The primary goal is helping to spread our 
secret of using the available mon and materials to produce what people collectively 
need, no matter where they are located or with what circumstances of plant, climate, 
and facilities they are now blessed. Our object must be to provide for them, ns 
wc havo provided within our own country, more of the things they need. We provide 
these not by giving it to them but showing them in the way they can get them for 
themselves. This is what we mean by the transfer of technology. 

Quality control activity can play an important part in this exchange of 
technology for quality control can provide one of the keenest cutting edges through 
which now methods, new techniques can be extended. Qualitv control, broadlv 
speaking, means those methods by which a satisfactory, adequate, dependable 
economic product quality can be developed according to the needs of the people 
being served. These methods must be implemented through management, seeking 
to define the needs or desirable ends and where necessary to break through the developed 
customs whether these are years, generations, or centuries old. Quality control can 
be used, once the desirable ends are defined, to seek, to mobilize the available labour 
and materials towards the satisfaction of those ends. 
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These broad aims and objectives of quality control fit in with the dynamic 
concept used in Administrative Applications. Administrative Applications have 
most directly related to management of affairs, as in applications in the office, applica¬ 
tions in inventory policy, applications in the legal field. These have all demonstrated 
the degree to which management can use quality control methods in support of 
management objectives. International thinking follows this same approach without 
distinguishing. between the technical and the administrative. It considers how 
quality control methods must be developed toward the goal of providing technological 
impetus bv which others can break through years of poverty and despair into those 
of increasing standards of living and general material betterment. Thus it is appro¬ 
priate to use this occasion of the annual meeting of the Administrative Applications 
Section to explore this problem of our international uses of quality control. 


3. Two ASPECTS OF QUALITY CONTROL ACTIVITIES 


Of the two aspects of international quality control activity we consider, 
the first is the way in which quality control activity has spread through many 
nations of the world; Japan, India, those of Europe, and throughout the USA. 
In discussing this current historical aspect, we shall bo concerned with the method 
of transmission, for the international progression of quality control activity is in 
many ways an extension of the progression within our domestic boundaries. We 
find four implementing factors to bo important: the impelling purpose, initial training, 
path breaking consultants, and organized continuing relationships. 

The other aspect of international activity relates to the way in which wo 
should bo using these techniques to stimulate and encourage technological develop¬ 
ments in the under developed countries. The tools for this help and stimulation 
have been honed and sharpened, but have not yet been fully implemented. Wo 
quality control practitioners as a group have not yet made ourselves he ard as effectively 
as wo should in terms of great challenge of the century, nor have we been called 
upon to bear our portion of the load. 


Let us be clear as to what we mean by quality control activity. Quality 
control conveys the sense of all those actions in design, production, and use that 
lead to a product quality that is adequate, satisfactory, dependable, economical. 
It includes the specification of what is wanted, the production according to that 
specification, and the methods of assuring that their specification has been satis¬ 
factorily met. These methods are implemented through the institution of manage¬ 
ment cither on a plant level, industry level or a national level. Quality control 
activity thus can relate to the broadest national need at which satisfactory product 
quality can be defined and achieved. 

Quality control operates through the techniques of statistics, Shewhart Control 
Charts Design of Experiments, Probability Sampling Plans, and the other methods 
Slt have developed'around these basic probabilistic tools. But quality co ntro 
consists not so much of these tools, as the manner in which they are used. To 
cannot be used without purpose. Tt is the difficulty of develop,ng purpose that 
customarily the problem of the quality control pract.t.oncr. 
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Customarily we think of quality control methods being applicable in a plant 
or in an office to control the flow of product according to the desired specifications. 
We have long come to think of spotty quality control applications as being of little 
value, that is, a control on a single machine in a plant when the rest of the plant 
is uncontrolled. We think of the need for an integrated quality control programme 
in order that quality control effort throughout the entire plant can be most effectively 
used. This might be called a plant-wide application of these techniques. Similarly 
those who have worked in other countries with national responsibilities have found 
the need for initiating quality control applications, not only plant-wide, but on an 
industry-wide basis. Here we study how to effect the maximum potential usefulness 
of quality control methods throughout an industry, on the assumption that effective 
quality control in one plant would be of little value were it not reflected in other 
plants in the same industry. Similarly quality control on a national scale faces tlie- 
question of how to allocate scarce resources among the various industries so as to 
make most effective use of quality control technique from the point of view of the 
country as a whole. Applications in some industries might be most fruitful whereas 
applications in other industries might scarcely pay their cost. Some people have 
described this as "applying quality control to quality control’” itself. This might be 
interpreted to mean that quality control techniques should not be used indiscrimi¬ 
nately but only where they will do relatively most good. 

4. Quality control in other countries 

Quality control is used today throughout most of the industrially developed 
countries of the world. Most of this development has been post-war, as has been 
the development of quality control in the United States and Canada. Differences 
relate to the effective starting of quality control efforts and the intensity of applica¬ 
tion. What we propose to do is to make a rapid survey of these quality control 
developments abroad. We shall sec that many of these developments abroad were 
stimulated by technical assistance in its proper sense, that is, by helping others to 
help themselves. 

In JajKin quality control was implemented early in the post-war period largely 
through the efforts of an American expert, Dr. W. Edwards Deming. Dr. Doming 
visited Japan, lectured throughout the country and assisted in the development 
of an effective quality control organization. Japan's need for quality exports provided 
the compelling purpose; Dr. Doming provided the consultation, initiated the training, 
and helped to found a continuing organization. The Japanese Union of Scientists 
and Engineers (JUSE), under the able leadership of its Executive Director, Kenichi 
Koyangi, provided the organizational background through which Dr. Dcming’s 
lectures were most successfully applied. This organization has pioneered the quality 
control development in Japan, it arranges for meetings of quality control groups 
throughout the country. It offers an annual prize for the best work in quality control, 
the prize being known as the "Deming Prize.” JUSE publishes a journal of very 
high quality. It also has in the past years broadcast courses in quality control over 
the national radio during the afternoon hours. In many plants people were excused 
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for this time to participate in the training course. It is reported that over a hundred 
thousand text books were ordered by those taking last year’s course. In addition 
to tlie work of JUSE, the University of Tokyo as well as many other colleges and 
technical schools throughout the country offer advance courses in quality control. 

Quality control in Japan received its greatest impetus through the control 
o! export production. Exports play a major role in that country’s economy. Soon 
alter the war Japan attempted to change its national image from that of low imitation 
Product quality to an image of high quality both in production and design. As every 
attempt was made to ensure that the products going abroad could compete effectively 
on a quality basis, as well as price. Post-war cameras, microscopes, radios, and 
mechanical products of all types have been acclaimed throughout the world for their 
quality. This national drive for a quality of export product not only stimulated 
the sense of quality control techniques in the plants but made effective use of quality 
control techniques in the evaluation of material leaving the country. Sampling 
techniques have been used extensively in control of export quality. This national 
concern with quality has reflected itself through the intensive application of quality 
control methods in many of the plants. 

In my visits to Japan, I was very much impressed with the planned procedures 
established to make effective quality. Quality control systems are meticulous in 
their detail, effective in their application. Applications of these techniques are 
common throughout the country. Japan today represents probably the most effective 
national application of quality control techniques throughout the world. Japan 
has learned to use, in fact, has made a national fetish of quality control, to help raise 
its standard of living and its national well being. It has learned to help itself by 
adapting the tools of modern technology. 

In Evro]te quality control techniques were stimulated during the Marshall 
Plan clays through the American expert, Professor Paul Clifford. Professor Clifford 
spent a year in Europe stimulating quality control groups in various countries and 
helping to found the European Organization for Quality Control. Drs. Joseph Juran 
and Sebastian Littaner also participated, as did Dr. Deming. This organization, 
EOQC, under the Executive Directorship of Dr. J. D. N. de Fremery. has acted to 
stimulate quality control techniques in the many separate countries. Its members 
are the national organizations established in England, Sweden, France, Germany, 
Belgium, Holland, and in Italy. Quality control organizations have been developed 
in some of the other countries; Spain, for instance, but it has not yet become a member 
of EOQC. EOQC publishes the quarterly journal Sigma. It holds national meetings. 
The EOQC meetings are sponsored by the various country organizations in turn. 
The last meeting held in Turin, Italy, was sponsored by the Italian Society for Quality 
Control. It was an effective meeting which Dr. Juran and Dr. Feigenbaum parti¬ 
cipated in. The previous meeting held in London and sponsored by the British 
Productivity Council, attracted the largest attendance yet recorded by EOQC. 
Previous meetings were convened in Brussels and Germany. The president of EOQC 
is Frank Nixon of the Rolls Royce Co., England. The previous and first president 
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was Walter Masing of Germany. This organization has provided an effective bond 
of industrial contaet among the eountries of Europe that fo«shadowa the common 
market community. Quality control is now effectively appl.ed ,n these count s. 
The development of the common market should make for a more effect.ve and 
spread applications of these techniques. 

Not aU quality control developments in Europe have occurred at the same 
time. In England, for instance, very effective and stimulating work in quahty control 
is now being done by Frank Nixon of Rolls Royce. Not only has he sparked tho 
EOQC, but he has stimulated quality control meetings throughout England during 
the past several years. He has also been elected as chairman of the Br.t.sl. National 
Council for Quality Control and Reliability, the title indicating the recognition of 
the affinity of these techniques in that country. England, having developed much 
of the theoretical ami statistical background, has been slow to embrace these tech¬ 
niques. but industrial rationalization and plant modernization is now requiring more 
effective methods of control. It is thus expected that these will be more fully 
practised in tho future. 


Yugoslavia, not yet in the western orbit, has embraced tho concept of a 
completely market economy. Recently it has shown an increasing interest in tho 
development of quality control techniques as a means of stimulating its productivity 
and its quality of product. Quality control courses have been given at the University 
of Belgrade and through the Yugoslavia Productivity Center. These courses have 
included other related fields of management control such as work study, operations 
analysis, linear programming, etc. Some applications have already been made in 
industry, but there is great room for the development of techniques in that country. 


One of the great interests in quality control in Yugoslavia was in establishing 
a national evaluation of product quality, similar to that accomplished by such 
organizations as Consumers Union in this country. Consumers Union attempts 
through its Consumer Reports to provide comparative product ratings on many 
consumer products. People in Yugoslavia felt that a similar organization was 
necessary in order to assure that the quality of a product reaching the market, 
now free and open to various competing organizations within the country, would bo 
controlled to a desirable extent. Their concept of quality control on a national 
basis thus starts at the consumer end, the control of products reaching markets. 
Were this as effectively done for consumer products as is for export products in Japan, 
tho effect would filter back through the development of quality control, controls at 
all stages of dosign and production throughout the country. 


In Russia not much is known about the development of quality control, 
but some steps have been taken through the Moscow Institute of Sciences. Mathe¬ 
matical applications of statistics have been divided into two branches, theoretical 
and applied, respectively, under Professors Smirnoff and Kolmogoroff. Ingenious 
control chart devices, primarily for the control of individual units rather than for 
samples havo also been developed to replace the Shewhart Control Charts. The 
42 
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extent to which quality control techniques have been applied throughout their plants 
nnf l industries is. however, not well known. There does appear, however, to be 
increasing interest on this line. 


In India, quality control has long been seen as a fitting adjunct of the deve¬ 
loping industrialization of that country under its successive five-year plans. As 
early as 1047 Professor Mahaianobis invited Dr. Walter Shewhart to come to India 
to give lectures in quality control. As the result of his visit the Indian Society for 
Quality Control was established. In 1954 a group of Americans including Professor 
Ellis Ott, Professor Paul Clifford, Professor Mason Wescott, under the direction of 
the United Nations Technical Assistance Programme, gave a three-months series of 
lectures in the principal cities of India. This work was sponsored by the Indian 
Statistical Institute under the Chairmanship of Professor Mahaianobis. Following 
this series, many foreign experts, including myself, spent some time in India working 
with the Indian Statistical Institute and its developed SQC Units. These efforts 
have yielded generous dividends inasmuch as quality control is now well established. 

The present key to quality control practice in India is the SQC Units, which 
are established in seven of the principal industrial areas in India; namely, Calcutta, 
Madras, Bangalore, Coimbatore, Bombay, Baroda, and New Delhi. These SQC 
Units arc manned by young statisticians and engineers who work with the industries 
of the region. Unfortunately, neither ISQC nor the Quality Control Society, Bangalore 
has grown nor assumed the organizational role of ASQC here. 


These SQC Units offer direct consulting services to manufacturers and training 
courses in SQC for their staffs. Their most effective work is in stimulating manage¬ 
ment effort to use quality control techniques effectively. My work in India during 
1958 was principally as advisor to these Units. We found, then that training in 
SQC was effective only if there was adequate follow-through, following the trainees 
back to their plant and proposing management programmes for the plant as a whole. 


Training by itself lacks a great deal if the trainees arc left to fend for themselves in 
view of the encrusted lines of authority within the usual plant. However, when 
these trainees are supported by outside consultants, a bridge is provided between 
management, their quality control groups, and the SQC Units. In the 100 or so 
plants that I visited, productivity increases in the order of 5 to 20% was found to 
be potentially available through the effective use of quality control, within the same 
level of technological skills available in that country. Industries included in quality 
control programmes were sewing machines, lamps, jute, cotton textiles, glass, radios, 
potteries and many others. These industries included both plants with old equipment, 
and machinery, as in the jute industry, or with modern brand new equipment as in the 
glass, and pharmaceutical industries. Quality Control was able to show sizable gams 
in either case. The reason for this was that quality control dealt with measuring 
the quality aspects of parallel units within a plant or industry with the object,ve of 
bringing up the weakest links to the level of the strongest. Thus wrthm the level 
of technology already potentially available within the country, very appreciable 
gains were made without increases to capital equipment or plant. By helping the 
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Indians to help themselves, that is by securing the most out of the technology 
already developed and available within the country, very sizable increases in pro¬ 
ductivity are found to bo available. 

Parenthetically it might be said that quality control technique in India 
serves as the most effective wedge in providing technical assistance on a national 
scale. For by quality control techniques the significant problems of imbalance in 
the use of existing facilities could be determined and the need for proper technical 
skills could be applied. This is in contrast to many ways in which foreign technical 
experts have been used, for they have found when they visit foreign plants that their 
technical skill is on such a different level and based upon such different precept* that 
they cannot usually be effectively employed nor their suggestions economically followed. 
My general finding in India was that the biggest job was the discovery of problem 
areas to which management could address itself. Once the problems were uncovered, 
there was usually available the necessary technical skill for the level of technology 
that existed. The parallel to this is the observation that technical assistance must 
be adopted to the technological level for new plants and equipment do not necessarily 
solve the problem unless they can be readily fitted into the existing technological 
level or be shown clearly to raise it. This illustrates the point that technical assistance 
must work through management to achieve existing management aims, although 
these aims also arc capable of gradual change and adjustment. 

Summary op foreion experience 

This brief review suggests that quality control activity is developing rapidly 
abroad. Four factors have been found to be important in this growth; national 
purpose, initiating consulting services, training, and the development of a national 
organizational framework for further growth. National purpose has been illustrated 
by the striving for export quality in Japan, the stimulation of consumer product 
quality in Yugoslavia, the planned industrialization as in India. These national 
purposes are counterparts of the war emergency that stimulated the initiation of 
quality control developments in the United States and Canada. 

Consultants have had an important stimulating effect in providing do-it- 
yourself information for others, as evidenced in the work of Deming in Japan; Clifford, 
Juran, Littaner in Europe; Shcwhart, Ott. and Pabst in India. Their work has been 
carried on through the development of quality control societies and other organizations 
to provide for internal expansion of the ideas and methods. 

Two corollaries of this influence of quality control in international develop¬ 
ment are important: the appeal to management objectives framed in accordance 
with national purpose, and tho acceptance of the level of existing technology. Quality 
control applications must be energized by management attention with the necessary 
bridging to the new methods and techniques. Quality control accepts the existing 
technology and shows how it can be improved in small and regular steps. It does 
this by studying the imbalance in the existing system, the differentials in productivity 
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of parallel lines within a plant for the purpose of bringing the lower up to the level 
of the better ; of imbalance in parallel facilities, or plants, for the same purpose. It 
measures these imbalances by means of quality measurements, by number of defects, 
by quality of out-put, by rates of utilization and the like. By finding the means 
of helping people do better with their existing facilities, it provides the tools for 
looking forward to better ones. 


5. Quality control in less developed countries 
Having had such an important effect in many countries, quality control 
should play a very important part in the transfer of new technology to the newer 
nations of Africa. South America and Asia. Quality control methods should 
help to provide the climate of management control and opinion in which new techno¬ 
logy can be utilized effectively. What is needed to make quality control effective 
in these newer countries? 


The review of quality control development suggests that four factors are 
important. The impelling motive, the use of consultants, the training of quality 
control practitioners as well as management, and the development of some continu¬ 
ing association cither voluntary or state supported. Wo shall examine how these 
factors apply in this newly developing situation. 


With respect to compelling motive there must be in a new country some 
parallel to the drive for control export quality as in Japan, mobilization of national 
effort ns in the United States during war time, or some national drive as represented 
by India’s five-vear plans for increasing productivity. Some driving force for 
obtaining increases in quality and productivity must bo evidenced. The existence 
of the motives, however, is not enough to encourage the use of quality control without 
an awareness that quality control can support the attainment of these ends, an 
awareness that, at present, may not exist. So far no other country than India 
has requested technical assistance in quality control from the United Nations. India 
requested such aid because India’s Professor Mahalanobis was aware of the potential 
contribution that quality control might make. The other newer countries however, 
may not have professors of the Mahalanobis type to plan the kinds of technical assist¬ 
ance they should require. This awareness must be created first by showing how 
cffectivc.'v these techniques have already been used under ex.stmg —one and 
secondly how they might apply in specific instances to the problem m hand. Th s 
awareness must be created in the under-developed eountr.es themselves, and in the 
technical assistance agencies in this country. Creation of this awareness is a res 
nihility that the ASQC might undertake as a broad pubhc serv.ee. 

Parenthetically it should be observed that the quality problems existing in 
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of preventing defectives before they arc produced, of mobilizing men and material 
in tho most efficient way to serve the given ends occur repeatedly in much the same 
form. The difference is that the problems presented in an under developed economy 
are usually easier to discover and correct than they are in a developed one. The 
gains in productivity in some plants in India amounted to nearly 200% from the 
application of quality control techniques. The gains from quality control are essen¬ 
tially independent of the level of the existing technology. The sine qua non is 
management interest and compelling objectives requiring fresh and forceful 
action. 


A second requisite for using quality control techniques to help under-developed 
countries is the availability of consultants, also a scarce resource. Consultants must 
be knowledgeable, enthusiastic, and sufficiently elastic to be able to apply their 
methods to the existing technology whatever its level. The consultants ordinarily 
must come from those nations in which quality control has been established and 
which they have had actual experience in applying these techniques broadly in a 
variety of industries. These consultants are difficult to find owing in part to the 
fact that quality control practitioners in this country have not been made aware of 
the challenging opportunities abroad. 

The third and fourth factors dealing with the successful use of quality control 
in transplanting technology deals with training and organization. A consultant 
must provide the initial training within the country and establish the self-generating 
basis for further training. He must also provide some organizational framework in 
which formal training as well as formal exchange of ideas can be developed. A 
professional society modelled on ASQC is one approach to such a continuing organiza¬ 
tion. Another is some semi-governmental organization, as in the SQC Units in India. 
Such organizations are not easily initiated or nourished to maturity. Without them 
the work of consultants in quality control is largely wasted on individual applications. 
Obviously this is one of the considerations that must be considered if quality control 
is to be a continuing effective force within a newly developing country. 

6 . Conclusion 

The balance is thus not promising. Of the four factors a compelling quality 
motive is ordinarily not present in under developed countries, nor are consultants 
available ordinarily, nor if they were, the opportunity for training within the 
country and the possible development of continued organization are by no means 
certain. The prospect is not encouraging but it poses a real and vital challenge. 

We know that quality control methods have been effective in transferring 
technology across international boundaries. We have seen the effective results in 
Japan, in India and throughout Europe at all levels of technological development 
Wo know that these methods can be used effectively in under-developed countries 
The problem that we face is two-fold: (1) in letting these under-developed countries 
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recognize the potential benefits that quality control techniques might bring to them 
in their development toward some constructive purpose, and ( 2 ) reminding each 
other in some organized way that we can be of help, that quality control methods 
can assist in meeting this major problem of our generation. 
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ESTIMATION FOR THE GENERALIZED POWER SERIES 
DISTRIBUTION WITH TWO PARAMETERS AND ITS 
APPLICATION TO BINOMIAL DISTRIBUTION* 

By GANAPATI P. PATIL 
McGill University 
1. Introduction 

Let T be a non-null countable subset with no limit point of real number* 
and define the series function f(0) — E a M 0*, the summation extending over T, 
with a„ > 0, 0 0 > so that f(0) is positive, finite and differentiable. Then the 
distribution of a random variablo X taking values in T with probabilities 

p{x; 0) = prob {X = x) - J'jjj xeT ... (1) 

is called a generalized power sorios distribution (GPSD). The author (1901, 1902a, 
1902b, 1962c, 1962d) has studied some problems of statistical inference associated 
with the GPSD with parameter 0 given by (I). In tho present paper, we consider a 
GPSD with two parameters taking the form 

p(x\ 0, A) = prob{2T =x) - xeT ... (2) 

whero f(6. A) = £a^A)0*, tho summation extending ovorTsuch that/(0, A)is positive, 
finito and diflerontiablo for all admissible values of the two parameters 0 and A and tho 
positive coefficients a,(A) now depend on * and A. The binomial and negative binomial 
distributions are special cases of tho GPSD (2) when they arc considered to bo the 
distributions with two parameters. 

2. Estimation of the two parameters for the GPSD 
To estimate 0 and A on tho basis of a sample x { (» = 1 , 2, ..., N) of size N 
from (2), the logarithm of likelihood function is 


log L = constant * S *, log 0+ £ log <A)-N log/(<?. A). 
The "efficient score” for 0 is then 

T, = Y l{ 0, A) = £ (log L] = " [*-**, A)] 


... (3) 


where p(0, A) = E(X). 


Tho results of this paper form a part of tho work carried out by tho author while ho was a« .... 
ludion Statistical Institute and tho University of Michigan. 1 th 
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and the likelihood equation T,(0, \) = 0 reduces to 

X = //($, A) 

which is the same as the first-moment equation. 
The “efficient score” for A is 


... (4) 


(5) 


'V 2 = 'V 2 (0, A) = [log L] 

- * [ h k 108 - WIN -/a A) 1 • 

and the estimating equation T 2 (0, A) = 0 becomes 

•f. log/<«, A) = 2 d log WIN. ... (6) 

cM f-i aA 

This, however, is not a moment equation. The second momont oquation will bo 

5* - A) 

whore 5* = 2 - (7) 

f-i 

Thus, unlike GPSD’s of the form (1) with singlo parameter, GPSDs given by (2) with 
two parameters do notyiold identical “moment” and "maximum likelihood” estimates. 
The elements of the "information matrix" 


are given by 


-(fe fc> 

... (8) 

•• 

II 

1 

eq 

_ 1 Cj 

y 

n 

*1* 

n 

... (9) 


... (10) 


... (11) 


2 

\ loga,(A)j . 


The asymptotic "dispersion matrix” of the estimates 8. A obtained by solving 
(4) and (6) is then given by 

var (5) cov [ 8 . A) \ = (12 ) 

v cov (0, A) var (A) / 

Tf . , , A u — u(0 A) and A are regarded as the parameters, the maximum 

If instead of 0 and A,/t MK » ' .. This follows from 

likelihood estimates of /. and A are asymptot.caUy uncorrelated. Hus 

( 10 ). 


( 
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3. Estimation ok tiir two parameters for tub binomial distribution 
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The GPSD (2) becomos 

j**; o. A) = (*)<>7<i+0)* *-0.1.8:.•» - < l3 > 

when J(0, A) = (I -\-0)'. Writing 0 = n /{\— n) and A m «, (13) gives the binomial 
probability function in the well-known form 


j>(x\ rr.n) = { "J n r (\—n)*-* * = 0, I, 2, .... n 


... (14) 


for which one has / 1 = nn and //* = nn(l — n). 

The binomial distribution has essentially two parameters n and n of which 
n is usually known and only n has to be estimated. However, certain cases might 
aviso in which n is unknown, and both n and n have to be estimated. For instance, 
whilo experimenting with a radioactive substance, in addition to the mean number 
(/* = nn) of disintegrating atoms, it may perhaps be of interest to know the number 
00 atoms capable of disintegration for the substance in fixed intervals of time for 
some specified solid anglo and fit a model correspondingly. 

To estimate n and n on the basis of a random samplo of size iV with observed 
frequency n x for x (£n a = N) drawn from (14) with n unknown, the moiuont-csti mates 
aro given by 

X = nn ... (15) 

and S* =* mr(l-/r), 

whoro X = XmJN and S* = Zn t {x-X)*IN. 

Tho likelihood equations reduce to 

X = hit 


( 10 ) 


and 

where 


.Ln-r+^oSd -*)- 0 


T r +i — 


S n M . 
X>t 


Eliminating n from (17) and (18) we have to solve for n, tho equation 

T. 


+**■»[»-;]- o- 


(17) 

(18) 


(19) 


The oloments of tho information matrix are : 

I\x = nN/n{l—n) 

In = JW-ir) 

1 22 = £ (2T r+1 /(n-r) a J = Af2(l— B{r\ n, n)]/(n-r)® 

^ ‘"L W ° n0t ° that " is a parameter a„d also 

not 3 ^ °" MaCt Pr0p0rti03 of the «etimates arc, therefore. 


( 20 ) 
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4. Estimation for the truncated binomial and incomplete 

DIBETA AND TRIBETA FUNCTIONS 

The applications of truncated binomial distributions have been discussed by 
several authors. The probability function of a truncated binomial with truncation 
points, say, at c and d can be written as : 



6*(*; ») = [S"(c, d, n, »)}-* • ( n x ) **(1 -»)"-* 

... (21) 

with 

x = c,c+ 1 . d, 0 <c<d<n 


where 

B-(c, d; 7T, n) = B(d; n, n)—B(c— 1, n, n) 

... (22) 

and 

B(r; n, n) = S b(x\ n, n) 

... (23) 


which can bo written as the incomplete beta function 

/i —(n-r, r+1) = u*- r -'(l-u) r du/ Ju"- r -»(l-tt) r du. ... (24) 

0 0 

The first two moments about tho origin of (21) can bo obtained as 



= n\c, d\ n, n) 

= 7i7r • B*(c— 1, d — 1 ; n, n—l)l B*(c, d; n, n) 

... (26) 

and 

ml = ml (c, d\ n, n) 



= d\ it, n) • [l+/**(c—1, d — 1; n, n — 1)]. 

... (20) 


It is easy to see that a truncated GPSD is a GPSD in its own right and honcc tho 
truncated binomial is also a GPSD and tho results obtained for (2) apply to (21). 

To estimate v and n on the basis of a random sample of sizo N with observed 
frequency n x for x (En x = N) drawn from tho truncated binomial, (21), tho moment- 
equations are : 

X = /i* ... (27) 

and S* = ml, ... (28) 


where X = ZxnJN, S 2 = Y.x z nJN and p and ml are defined by (25) and (26) res¬ 
pectively. 

The "efficient scores” for n and n reduce to : 



N 

7T(\—7T) 


(*-/0 


(29) 


and 


T 2 = 2 Tr+i+N log IB- ... (30) 

2 r?0 n—r On 


whore B*’s are dofined by (22). 
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Tho likelihood equations then become 

* = £• 

and = 0 . 

Tho elemonts of “information matrix" aro 

_ N W 

11 77(1—7r) ' dn 

J _ n_ 

12 77(1 —77) ■ dn 

and /--(& * 7 **“(£ */*)*]+* *<£&.• 

(31) and (32) may bo solved for estimation, approximating 


d 

dn 




and getting 


AB 

An 


from binomial tables whero B is defined by (23). 


... (31) 
... (32) 


... (33) 


Howovor, exact values of B(r,n,n) and ^ B(r; 77 , n) which wo shall call 
“Incomplete Dibeta and Tribeta Function" respectively, can be obtained ns follows: 


g n B ( r '» » w) = £ (n r, r+ 1 ) 

= h-A*-r t r+DJ^n-r, r+ l)HZl’ 9 .» (34) 
whero 7’s aro incomplete beta functions, and 

/ log u u"-*(l—u )"- 1 du 

E t (n, m) = \ - ... ( 35 ) 

J u* _, (l— u) m ~ l du 

which means tho expected value of log u when u follows a beta distribution truncated 
on the right at z, with parameters ti and m. E t (n, m) can bo reduced to 


" s * / «( n + r » m —0 

r-0 71+r 


E t (n, m) — log z— 


7,(71. 771) 


... (36) 
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In particular, 


E i(n, m) = - "f 1 —1—. 

r-o n-fr 


... (37) 


(30) suggests that the values of “Incomplete Dibeta Function” can bo exactly obtained 
by using tables of “Incomplete Beta Function” which are extensively tabulated. 

To obtain "Incomplete Tribeta Function” 

”.n) = g n /,..(»-r, r+ l)[S,(„_r, r+1)] ... (38) 

wo got aftor somo simplification of (38), 

i r, n) = r+l)({(^n-r, r+l)]|—)*+[F^n-r, r+l)J—) 

... (39) 

where V t (n, m) is the variance of log u when u follows a beta distribution with para¬ 
meters n and m truncated on the right at z. F,(n, w) can bo obtained from 

V t (n, m) =* £*(n, m)—[E t (n, m)] 2 ... (40) 

whore E\ (n, w) can bo reduced to 

E a .(n, m) = (log*)*- E,{n+r, n-r). ... (41) 

r-o . n-f-r 

In particular, 

£}(»,«) = 2_!-,)/(„ + >•). ... (42) 

6. ILLUSTRATIV’E examples 

The computation procedure for simultaneous estimation for tho complete 
binomial (14) will bo illustrated with reference to two examples : one on radioactive 
disintegrations and tho second one on throwing of dice. 

Example 1 : The first two columns of the following table give data collected 
by Rutherford and others, showing the number (n x ) of intervals of time, each of 7.5 
seconds, during which the number (x) of a particles emitted from a certain radioactive 
substance. 
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TABLE l. DATA : RUTHERFORD AND GEIGER : RADIOACTIVE 
DISINTEGRATION 


number of 
a particles 

number of 
intervals 

Tx - £ ", 
O* 


T x 

n— x + 1 

X 

n x 

Tx 

n~77 

n-79 

0 

67 

2608 

— 

— 

I 

203 

2551 

33.1299 

32.2911 

2 

383 

2348 

30.8947 

30.1026 

3 

625 

1905 

26.0000 

25.6196 

4 

632 

1440 

19.4594 

18.9474 

5 

408 

908 

12.4384 

12.1007 

C 

273 

500 

6.9444 

6.7608 

7 

139 

227 

3.1972 

3.1098 

8 

46 

88 

1.2571 

1.2222 

9 

27 

43 

0.6232 

0.0050 

10 

10 

16 

0.2363 

0.2280 

11 

4 

0 

0.0890 

0.0870 

12 

2 

2 

0.0303 

0.0294 

total 

2608 

131.2995 

131.0005 

Earn, = 10094; X - 3.870; E**n, - 486.50; 

5* = 3.676; 

n =» 77. 


n 

77 

79 


iVflog n—log (n- 

-*)) ; 134.4390 

130.9693 


¥ 

j -0.1395 

+ 0.0372 


Moment estimates. Wo have for this data, 

N - 2608 


x = 


N 


3.870 


S t _ = 3 676 

so that the estimate for the mean number // of a-particles emitted por interval is 

A — X = 3.870, 

and the number (n) of particles capable of disintegration for the substance during tho 
interval of 7.5 seconds is estimated by 


77. 


X-s* 

Maximum likelihood estimate*. The estimate for the mean number of 
a-particles por interval remains the same, namely p = 3.870. To get the estimate h 
of n, starting with the moment estimate n = 77, we solve the equation : 

T(n) = f, sb-*n"g — '°8 <»-*)) = 0. 
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For n = 77, we have N[log n-log (n-*)] = 134.4390. From column 4 of Table 1 
wo have for n = 77, 


v Tr +' = S - T ' = 

,90 n—r ,> , n—x+l 


134.2995 


T(77)= 134.2995-134.4390 
= —0.1395. 


Let us try next n = 79, say. Now, N [log n —log (n— X)) = 130.9693 and column 
5 of the above table gives for n = 79, 


L 131.0065 

r 90 n—r 

'V (79) = 0.0372. 


Thus, whoroas 4^(77) is negativo, 4^(79) is positivo and therefore the likelihood estimate 
for n is n > 77 and <79. 

n = 78. 

Example 2 : The first two columns of the following table givo data, due to 
Weldon, that show the results of throwing n dice 4096 times, a throw of 4, 5 or 6 being 
called a success, x donotes the number of successes and n M the frequency of x. 


TABLE 2. 


8UCC«'HltOH 

X 

frequency 

T, - Zn. 
•>* 

Tg 


Tg 


n-x + 1 

n -12 

n-13 

nail 

0 

0 

4090 

— 

— 

— 

1 

7 

4090 

371.7273 

316.0769 

372.3630 

2 

00 

4089 

371.7273 

340.7500 

408.9000 

3 

108 

4029 

402.9000 

300.2727 

447.6606 

4 

430 

3831 

425.6007 

383.1000 

478.8750 

5 

731 

3401 

425.1250 

377.8888 

486.8571 

0 

948 

2670 

381.4285 

333.7600 

445.0000 

7 

847 

1722 

287.0000 

245.0000 

344.4000 

8 

530 

875 

175.0000 

145.8333 

218.7600 

9 

257 

339 

84.7500 

67.8000 

113.0000 

10 

71 

82 

27.3333 

20.5000 

41.0000 

11 

11 

11 

6.6000 

3.0666 

11.0000 

totul 

4096 


2927.7641 

2600.6383 

3366.8123 
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Sm x = 25145; X = 6.139; Zx*n x = 166367; 5 2 = 2.930; n = 12. 


n 

12 

13 

11 

iV[log n — log(n-S)] 

2935.1030 

2617.7000 

3344.9000 

T 

— 7.3389 

-17.0617 

| +21.9123 


Moment estimates. Wo have 

N = 4096 
X — 0.139 
S* = 2.930 

so that the estimate for the number of dice thrown is given by 



and the estimate of the proportion of successes ( n) is 


w _ X 6.139 

= n 12 


— 0.6110. 


Maximum likelihood estimates. To get firstly the estimate fi of n, starting with 
tho moment-estimate 7i ■= 12 , wo solve the equation: 

'•'<»> “ r S 0 £tL-NQog n—log (n-*)] = 0 . 

For n = 12, wo have 2V[log n-log (n-*)] = 2935.1030. From column 4 of Tablo 2 
wo havo for n = 12 , 


s 

ra»o n—r 


S —S»— 

*>i n—x+1 


= 2927.7641 


/. ¥(12) = 2927.7641-2935.1060 =-7.3389. 

Let us try nest n = 13. say. to see if >K(13) is near zero. We get by proceed¬ 
ing as before, '5'(13)-17.0617 which is further from zero than V( 12 ). Therefore 

we try n= 11. Wo have then T(ll) = 21.9123 which indicates that ft = 12. The 

estimate of w is then obtained by * = | = 0.5116. (Note : Weldon had thrown 12 


dice). 
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CRITERIA OF ESTIMATION IN LARGE SAMPLES* 


By C. RADHAKRISHNA RAO 
Indian Statistical Institute 

Summary 

The existing criteria of consistency and efficiency of estimation have boon 
examined in the light of recent criticisms and controversies concerning thorn. A 
now criterion called uniform first order efficiency which is a better indicator of the 
performance of an estimator in statistical infcronco has boon introduced. It is, how¬ 
ever, pointed out that the anomaly in the earlier criterion of efficiency can bo removed 
by considering consistent estimators which converge to a normal distribution uniformly 
in compacts of the parameter spaco. First order efficiency by itself cannot discrimi¬ 
nate among a large number of estimation procedures. Therefore, an additional cri¬ 
terion called the second order efficiency has been introduced, which considerably restricts 
the class of useful estimation procedures and by which several well established esti¬ 
mation procedures could be eliminated in favour of the method of maximum likeli¬ 
hood. 

1. Introduction 

Estimation, ns conceived by the late Sir Ronald Fisher, is one of the methodo¬ 
logical processes by which data arc analysed or reduced for purposes of drawing 
inferences on the unknown population from which data are observed. For instanco 
a sample survey of consumer expenditure may provide a mass of data which by 
themselves aro difficult to interpret. We therefore need summary figures or estimates 
which provide a fair idea of the characteristics of the population sampled and enablo 
us to answer a variety of questions. Has the per capita expenditure on rice increased 
over time and is it different in different regions? Does a given estimate reasonably 
agree with what is believed to be the per capita expenditure, or with another estimate 
obtained by a parallol agency? No clear indication of answers to such questions 
would bo available without computing from the data an estimate which represents the 
per capita expenditure and other quantities which indicate the possible extent of error 
in tho estimate and guide us in making judicious statements about tho population. 
Further questions may suggest thomselves after some initial questions are answered 
with the estimates already obtained. 

There has been a tendency to consider tho problem of estimation as a part of 
decision theory, requiring a prestated purpose for the estimate and specification of 
loss resulting from any given magnitude of error in the estimate. It is not, however, 
my view that the latter approach should be completely abandoned. There may bo 
situations where such an approach is necessary and appropriate as in the case of accep- 
tanco procedures in indust rial statistics. But in a majority of situations tho framework 

•Lecture delivered on the occasion of tho prescnt^io^oTsi.ann Sw^p Bhati^gaTa^rd 
for 1959. 

44 
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of decision theory may not be applicable and it may be necessary to consider the problem 
of estimation from a wider point of view as ‘extraction of information’ for drawing 
inferences and for recording it, as a substitute for the entire data, for possible future uses. 

Since estimation, however it may be viewed, involves reduction of data, it 
may entail some loss of information for we are interpreting the data through the 
estimates. The criteria for choice of estimators should then relate to minimisation of 
loss of information. Unfortunately, no objective measurement of information is pos¬ 
sible and hence the difficulty in the formulation of suitable criteria. However, asymptotic 
theories of estimation based on the criteria of consistency and efficiency (to bo referred 
to as v-efficioncy) have been constructed and certain methods have been shown 
to yield estimators satisfying these criteria. It was thought that the criteria of con¬ 
sistency and v-efficioncy ensure minimum loss of information duo to estimation as 
the sample size increases. 

These theories are not satisfactory due to three main reasons. Firstly, all the 
results relate to limiting properties as the sample size tends to infinity and no indication 
is available of their applicability to samples of sizes ordinarily met with in actual 
practice. Secondly, there seem to oxist infinitely many procedures leading to esti¬ 
mators satisfying the stated criteria and no further criteria have been suggested to 
distinguish among them. Thirdly, the criterion of v-cfficiency does not provido a 
satisfactory index of tho performance of an estimator from the view point of statistical 
inference. 

I have attempted to resolve these difficulties in some ways (Rao, 1960b, 1961, 
1962). Firstly, the criterion of ^-efficiency has been reformulated to ensure some 
optimum asymptotic properties of an estimator used in tho placo of tho samplo for 
purposes of inference. This is called first order efficiency. Secondly, another criterion 
known as second order efficiency has been introduced to distinguish among difTorcnt 
procedures loading to first order efficient estimators. On tho basis of tho latter cri¬ 
terion several well-known procedures, such as tho minimum chi-square, modified mini¬ 
mum chi-square etc., which are considered as competitors to maximum likelihood on 
the basis of w-efficiency, could be eliminated. The second order efficiency also provides 
a partial answer to the question of sample size. Correction terms of order 0(n~ l ) to 
the estimate and of order 0(n~ 3 ) to its precision have been determined for sevoral 
estimation procedures. 

The present paper is intended for a further discussion of first and second ordor 
efficiencies and to introduce a new concept of uniform efficiency which seems to be 
important when asymptotic theories are considered. Some new light is thrown on 
the use of asymptotic variance of an estimator as an index of efficiency. Further tho 
second order efficiency is linked with terms of order in the asymptotic expansion 
of the variance of an estimator. Problems requiring further investigation are indicated. 

In undertaking these studies I have been guided by tho basic ideas contained 
in two fundamental papers on estimation by Fisher (1922, 1925). I wish to record 
my debt of gratitude to the late Sir Ronald Fisher for the encouragement I received 
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from him when I was working under his guidance at Cambridge and during his recent 
visits to the Indian Statistical Institute. I also wish to thank Professor P. C. Mahala- 
nobis, the Director of tho Indian Statistical Institute for his stimulating discussions 
on the logic of statistical inference and the purpose of statistics to which I have been 
constantly exposed. 


2. Consistency 

The criterion of consistency is in tho nature of identifying the parameter for 
which a statistic is said to be an estimator. This is important from tho practical point 
of view of interpreting the estimates. There are various definitions of consistency of 
which the one frequently referred to in literature is probability consistency (PC). 

Definition 2A : Probability consistency (PC). A sequence of statistics 
T n is said to be consistent for a parameter 0 if T n -+ 0 in probability. 

But one criticism of such a definition is that it places no restriction on tho 
statistic for any given n. An alternative definition of consistency due to Fisher, 
called Fishor consistency (FC) seems to bo more satisfactory in this respect, but 
somewhat restrictive in application. 

Definition 2B : Fisher consistency (FC). A statistic T n = f{S n ), where S n 
is the empirical distribution function based on n observations and / is a weakly conti¬ 
nuous functional defined on the space of distribution functions is said to bo Fisher 
consistent if f(F g ) n 0, where F 0 is the true distribution function from which obser¬ 
vations are drawn. 

It is easy to sco that FC ==» PC and that FC refers to a restriction on the 
estimate for any finite n and is not just a limiting property of a scquenco of statistics. 
But it is applicable only in situations where independent observations are drawn from 
a population characterised by a distribution function. 

3. Efficiency 

Efficiency of an estimator, which we rename as v-officiency bccauso it is linked 
with asymptotic variance, is usually defined as follows : 

Definition 3A : v-efficiency. Consider the class {T n } of consistent asympto¬ 
tically normal (CAN) estimators of 0, i.e., for each T n , n*(T n —0)^*N[ 0, t>(0)). Any 
member of the sub-class for which v{0) = l/»(0) is said to be an efficient estimator of 0. 

It was believed that for a CAN estimator, the asymptotic variance v(0) satis¬ 
fies the inequality 


^> 1 ( 5 ) - (»■») 

and that an estimator with the smallest t*0) has maximum concentration round the 
true value in sufficiently large samples. Unfortunately, both these results are not 
Strictly true without any restrictions <?n the estimating function or the mode pf 
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convergence to normality. About ten years ago Hodges (see LeCam, 1953) 
constructed an example to show that the result (3.1) is not true in general. Let 


T n = * (|2| >n-”«) 'I 
= a x{\x\ < n- ,/4 ) J 

where x is the average of n observations from N(0, 1) and a is arbitrary 
verified that T n is also CAN with 


... (3.2) 

It may be 


t AO) =1, for 0 9*0 'j 

= a*. for 0 = 0 / 

so that the variance at 0 = 0 can be made arbitrarily small. Such an estimate has 
been termed 'super efficient.’ This example throws in doubt the oxact significance 
of v-efficiency. 

Even if there is no lower bound to asymptotic variance, the question remains 
as to whether we should prefer the estimator T n as defined in (3.2) to X because of smaller 
asymptotic variance at least at one point and equivalence elsewhere. It can bo easily 
seen that for any given n, T n has better concentration than 2, in the sense of higher 
probabilities for intervals enclosing the true value, only for the special values of 
^“0 and a small neighbourhood of zero, and thereafter for a continuous sot of 0, T n 
has less concentration than *. This may also bo inferred by comparing the mean 
square errors (m.s.o.) of T n and x. For any given n the m.s.e. of T„ is smaller than that 
of 2 for 0 close to zero and thereafter it stays larger, although the difference tends to 
zero as 0 increases. It may, however, be observed that the m.s.e. in cither case tends 
to the corresponding asymptotic value but the anomaly arises duo to convcrgonco 
being not uniform in the case of T n . Wo shall have occasion to stress the importance 
of uniform convergence in a later section of this paper. An attempt to improve the 
concentration in the neighbourhood of a particular value of the parameter seems to 
have injured the performance of the estimator at other values. A general statement 
to this effect is proved by LeCam (1953) using bounded risk functions. Superiority 
as judged by asymptotic varianco function need not therefore indicate greater concen¬ 
tration for all values of the unknown parameter oven in sufficiently largo samples. 

Consider another super efficient estimator U n , 


U n = s (|2| >n-" 4 ) 

= «*„ ( |*i <»->«) 


1 

J 


(3.3) 


where is the sample median and a is arbitrarily small. The statistics (3.2) and (3.3) 
have the same asymptotic variance and are therefore indistinguishable on the basis 
of v-efficiency. There must, however, be some difference in the performance of these 
two statistics, the estimator (3.3) being essentially equivalent to the sample median 
when 0=0. 

Since there is no lower bound to the asymptotic variance of a CAN estimator, 
it may be thought that an improvement over * is possible by constructing a statistic 
T with a uniformly lower asymptotic variance and thereby increasing the concentra¬ 
tion at every value of the parameter, as at 0 = 0 in examples (3.2) and (3.3). 



349 


CRITERIA OF ESTIMATION IN LARGE SAMPLES 

LoCara (1953) has demonstrated that such an improvement is not possiblo for any 
continuous interval of the parameter and the set of points with a lower asymptotic 
variance has to be of Lebesguo measure zero. 

Can wo avoid all these troubles by considering only efficient estimators in 
the senso of Definition 3A and not trying to improve upon the asymptotic variance 
l/»(0)? The following example provides an answer to this question. 

Let !F n = x 

= {-)'*. (i* 1 <n - ,,4) 

whero 2 is tho sample mean and x m is the sample median. IF„ is also CAN with the 
same asymptotic variance v(0) = 1 for all 0 as that of 2. The estimator W „ is thus 
indistinguishable from 2 so far as consistency and v-efficioncy are concerned. Yet 
for any given largo n, IF* has less concentration than that of l for all values of 0. 

It is no doubt true that an estimator having a higher concentration than 
another for every value of 0 is more useful in drawing inferences on 0 from an observed 
estimate. That such a situation is realised for an estimator compared to another for 
sufficiently large n cannot be judged by comparing the asymptotic variances only 
as shown by examples (3.2), (3.3) and (3.4). It is, however, difficult to chooso between 
two estimators when one docs not have uniformly better concentration than another 
without bringing in other considerations. For instance, we may have an estimator 
whose distribution for a particular value of 0 is highly concentrated but it will bo a 
poor discriminator between this valuo of 0 and other values close to it if tho concen¬ 
tration at tho other values is low. To compare the estimators x, T„, U„ and IF„, we 
may examine one aspect of their usefulness in statistical inference c.g., the power func¬ 
tions of tests based on these statistics to test the hypothesis that 0 has an assigned 
valuo. It may be inferred from tho optimum properties possessed by 2, that in largo 
samples 2 and T„ tend to have the same local power (Rao, 1962) whorcas U„ and \V * 
being equivalent to tho sample median when 0 = 0, will have a smaller local power. 
Sinco t> efficiency docs not onablo us to distinguish between estimators such as 2 or 
T n and U n or IF* wo shall consider an alternative definition of efficiency (to bo called 
first ordor) which appears to be more satisfactory. 

Definition 3B : First order efficiency. A statistic T n is said to bo efficient 

if 

„»|(T.-0)-/WZ.|i*O ... (3.5) 

where fl{0) is a function of 0 only, and Z n = *“*(<£ log P(X„, 0)/d0), P(X n , 0) being 
tho density of tho observations. The condition (3.5) implies that tho asymptotic cor 
rotation between T n and Z* is unity. 

I have shown elsewhere (Rao, 1960b) that according to definition 3B, T n is just 
as efficient as 2, although T n is super efficient in the sense of v-efficiency and U n and 
W n are not efficient in the new sense at 0 = 0 although U n and IF* are supor efficient 
and efficient respectively in the old sense. If the efficiency of an estimator is measured 
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by the square of its asymptotic correlation with £„, then U r and \V n have the same 
efficiency 2/n < 1, although U n and W n have different asymptotic variances. It is 
also Shown (Theorem 2 in Rao, 1962) that an estimator satisfying, or efficient in the 
sense of Definition 3B provides a locally more powerful test of a simple hypothesis 
concerning 0 than any other test in sufficiently large samples. Another important 
consequence of Definition 3B of efficiency is that the ratio of I(T n ) the Fisher’s 
information contained in the estimator T n to /, the total information in the sample 
tends to unity asn-»co (Doob, 1934; Rao, 1961). 

The Definition 3B of efficiency implies that the limiting distribution of n){T n —$) 
is normal for any given 0 and in largo samples, any simple hypothesis on 0 can bo tested 
by using the normal approximation. But in problems of statistical inference, it is 
often necessary to express our preference for different values of 0, on the basis of the 
estimate as in the case of interval estimation, and not just examine whether a parti¬ 
cular value is true or not. There is thus for a given n, a need to consider the whole 
set of distributions of the estimator for all values of 0 at least in a small interval (in 
largo samples) where different values of 0 have to be distinguished. If the distributions 
are to be approximated by appropriate normal distributions, it seems to be a logical 
necessity that the convergence to normality of the chosen estimator should bo uniform 
in compacts of 0. Under fairly general conditions the convergence to normality 
of n*Z„(0) is found to be uniform in which case the desired property is assured by the 
following definition of uniform first order efficiency. 

Definition 3C : Uniform first order efficiency. An estimator is said to have 
uniform first order efficiency if 

DL 

n *\T n —0 — Z n (O)/i(0)\ ->0 ... (3.6) 

in compacts of 0, where the symbol UL stands for uniform convergence in law and 
i(0) is Fisher’s information per observation. 

It would have been more natural to define uniform first order efficiency as 

n*\T n -0-mZni*)\™0 ... (3.7) 

without specifying the value of fi(0) as in (3.6). It appears that if the condition (3.7) 
is satisfied for various values of then it is desirable to choose an estimator for 
which fl(0) is a minimum which is shown to be [«(0)]“* in section 4 of this paper. 

4. Some lemmas 

Notations and assumptions. We consider only sequences of independent and 
identically distributed variables with probability density p{x, 0), where 0 is a parameter 
with values in an open interval 0. In the case of discrete variables, p(x, 0) represents 
the probability of x. The probability density of n observations is denoted by P(X n , 0). 
The first derivative p\x, 0) = dp{x, 0)ldd exists. Let a(x, 0) = p'(x, 0)/p{x, 0) and 

m = E e [a(x, 0)? 

Fisher’s information per observation be continuous in 0. Tho following assumptions 
are made in the various lemmas of this section. 



CRITERIA OP ESTIMATION IN LARGE SAMPLES 


351 


Assumption I : (i) /<(0 O , 0) = E 6 [a(x, 0 O )] = (0— O 0 )i[p 0 )+o(0— 0©) 

(ii) [<r(0 o , 0)f = F,[o(* f 0©)J = »(0©)+o(l) 

(iii) c(0 0 , 0) = cov 9 [a(x, 0), a(x, 0©)] = t(0 o )+o(I) 

Assumption II i E n < co for somo * > 0 in compacts of 0. 

p(x, 0)| 

Assumption III : 

Let &<*, 0, 0©) = log [p(x, 0)/p(x, 0 ©)) 

(i) W, 0©) = Eso[b(x, 0, 0©)] = Wo)+o(0-0 0 )* 

(ii) [V(0, 0©)]* - V to [b(x, 0, 0©)] = (0—0©)* HOj+oiO-O,)* 

(iii) £(0, 0 O ) - cov, 0 [6(*, 0 , 0 O ). a(x, 0 O )] - ( 0 - 0 e )i( 0 o )+o( 0 - 0 o ) 


Assumplion IV : (i) f 0)}dv = 

M m dO 3 

for every Lcbesguc mcasurablo sot E n , 




(ii) 




*>•(*, 0 ) 

P(*. 0) 


is bounded in compacts of 0. 


The Assumptions I, II, and III are not sovore. Conditions may bo imposed directly on 
the probability density to ensure them. For instance restrictions such as those im¬ 
posed by Danials (1961) on the probability donsity will imply the conditions (i)-(iii) 
of Assumption I. 


Lemma 1 : Let /?„(0) be the power function of any test of the hypothesis 0 *= 0 O 
based on a sample of n independent observations, at probability level a. Then under 
Assumptions I-III 


Umfl0 o +*»-») < 0(«-*»*) ... (4.1) 

where <I> is the distribution function of N( 0, 1) and a is the upper a point of N{ 0, 1). 

The limit of ^(0 o +0»”*) whon it exists is known as Pitman power of tho test. 
Lemma 1 gives an uppor bound to Pitman power under some conditions on tho pro¬ 
bability density of the observations. Two limit theorems of a different typo concern¬ 
ing the local power of a test have been given in an earlier paper of the author 
(Rao, 1962). 

Let 


ZnW) 


I 

n P(X m ,6) 


4- Satt,, 0 ) 

n 



P(X.. 6 ) 

P&„ 0,) 


=-i-2tto.0,0o) 


«.<*> = e o )]/v(0, 0 a ) 

-.W = n *[J'.+ «O„0)]/7to,e) 
*Jfl) = »‘3.(0)/[i(0)]». 
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Under the Assumptions I, II, and III, it is easy to show that 

(i) Ve o [u n (0)-w n (0 0 )]->0 as 0 


0 F 


<») Vfrjfii —» 0 as 0-. 0 C 


VL 


(iii) w n (0) —> N( 0, 1) in compacts of 0. 

The best test of the hypothesis H o :0 = 0 0 against the alternative 0, 


... (4.2) 

... (4.3) 

... (4.4) 
0 o -f <Sn“* 


is 


u n (0 n ) > c„ 

where c„ is chosen such that the size of the test -»aas n—► co. 

lim /’*[«,(*„) > C„) = lim Po o [u»(0 n )-u’ n (0o) + M'„(0o) > c„] 


(4.6) 


lim Pe o [u>„(0 o ) > C J by (4.2). 


Since the limiting distribution of u> n (0 o ) is ^(0, 1), c„—► a the upper a point of N(0, 1). 
The power of the test (4.5) is 
A*Wn) - P0MO n ) > Cj 

= P**M0n)-”n(0 H )+W n (0 u ) > C w 


“/'o, {».«?.) 


> e„+ 


nWc.O.H-5(0.. <?■>)] 1 
7(0.. Oo) ) 


writing u n (0 n ) in terms of v H (0J using their definitions. 


»J0.»c 

using (4.4) of uniform convergence, 
where -Si* = lim n*[W 0 , 0 n )+Z,(0 n , 0 o ))/y(0 nt 0 o ). The result of Lemma 1 follows 
by observing that #(0) > /?„(0) for each 0, where /?„(0) is the power of any other test. 

Lemma 2 : Let n*(T n -0)™ N( 0, (y(0)] 2 ) in compacts of 0, where y(0) is 
bounded. Then 

(i) y(0) is continuous if the probability density p(x, 0) is continuous in 0. 

(ii) [y(0)] 2 < 1 /»(0) under Assumptions I-III. 

We use an argument similar to that of LeCam (1960) to prove (i) of Lemma 2 : 

If p(x, 0) is continuous in 0 the distribution function F 0itt of T n is continuous 
in 0 and consequently the characteristic function c n (t, 0) of U n — n*(T 0) is 
continuous in 6. Since f/„ converges uniformly, c„</, 0) converges uniformly to c(t, 0) 
the characteristic function of the asymptotic distribution #(0, [y(0)] ! ). But c((, 0) 
is continuous. Hence y<0) is continuous in the interval of the uniform convergence 

of V,. 

Let us consider the test 

n*(T „ 0 O ) ^ , 


lim /?;(0 n ) = lim Po n { 

I —► oo n —► Ob 1 

= <I> (a—Si*) 
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of the hypothesis 0 = 0 O , at a probability level a. The power of the tost at U is 

fi n (0) = P # {**(T„-0 # ) > A n y(0 o )} 




y(0 o ) n«(0-0 o ) 
7(0) 7(0) 


Substituting 0 = 0 0 +8n~* and observing that the convergence to normality of 
n*(7'„—0) is uniform in 0, we find 

lim fiJLO'+tnr*) « <r>[a-*/y(0 o )) - < 40) 

n—>00 


whore the argument of <1> in (4.6) is tho limit of 

A„y(0o) _ ni(0-0.) 

7(0) 7(0) 

with 0 = 0 0 +8n-*, as w-> co. 

It is shown in Lemma 1 under Assumptions I—III 


Urn <0(a-«*). 

n—>» 

Henco from (4.6) 

<I>(a—£/y(0 o )) < <I>(a-*i*) 
or <*—8It(0q) > a—Si* 

i.o., y*(0 o ) > m°o) (for a, ‘y given 0„). 

We thus see that the asymptotic variance of CUAN (consistent uniformly 
asymptotically normal) estimator has Fisher's lower bound l/i(0) when the probability 
density satisfies some regularity conditions. It appears then that in tho examples of 
Hodges and LcCam, super efficiency in the sense of having asymptotic variance less 
than l/»(0) has been achieved at tho sacrifice of uniform convergence. 

Lemma 3 : Let 



Then 


... (4.7) 


(i) n*(T„—0)-> N{ 0, (y(0)]*) in compacts of 0, where y(0) is continuous, under 
Assumption II and continuity of p{x, 0), and 

(ii) y(0) = [»(0)] _ * under Assumptions II and IV. 

Under Assumption II, * 




(4.8) 


and hence 


n*(T — 0 ) vl 
7(0) 


N(0, 1 ) 


(4.9) 


since by the condition (4.7) of Lemma 3, the difference of (4.8) and (4.9) ^ 0, Hence 
tho result (i) of Lemma 3 follows. 

45 
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Consider the test 

n*(T m -0 0 ) > c n y(0 o ) .. (4.10) 

of the hypothesis 0 = 0 O at a probability level a, where c n — * a, the upper a probability 
point of N( 0, 1). The power of the test (4.10) at 0 n = 0 o -Mw-* is 
/?n(Oo+Sn-*) = Pe n MT n -0 0 ) > c n y(0 0 ) 



c w y(^o) _ n*(0-0 o ) i 
7(0) y(0) i 


lim fi n (0 0 +Sn-l) 

n —> e 


*ia-9M0 •)] 


(4.11) 


using the uniform convergence proved in (i) of Lemma 3. It appears from (4.11) that a 
test of the hypothesis 0 = 0 0 based on T n does not attain the full Pitman power 
<I>(a — Si*) unless y 2 = t -1 . It is therefore interesting to know whether the condition 
(4.7) of Lemma 3 itself implies that y* = * -1 . I have been able to establish this result 
only under the additional Assumption IV but it is worth examining whether such a 
strong assumption is necessary. 


Under condition (i) of Assumption IV wo have the expansion of the power 
function 


fuoo+*n-*) = /no, )+£m)+^/wn 


(4.12) 


and under condition (ii) of Assumption IV, /?'(0')/n is bounded in an interval of O' 
enclosing 0 0 . From (4.12) we find 


lim lim l.(0.+*"- t )-l(g.) = lim 

‘ * o 


Henoo lim < * >(< *—*/y>—^ ( « ) = , im »... (4.13) 

*0 0 

The limit of the R.H.S. of (4.13) is 

(t72w)*e-°*/2 ... (4.14) 

using the result of Theorem 1 in an earlier paper (Rao, 1962). The value of the L.H.S. 
of (4.13) is 

(2 wy*)-*e-« J / 3 . (4.15) 

Comparing (4.14) and (4.15) we find y* = i which establishes (ii) of Lemma 3. 

Lemma 4 : Let {n*(T n —0), n*Z„(0)}-* in law to a bivariate normal distribu¬ 
tion uniformly in compacts of 0, with the asymptotic covariance matrix 

(P(O)IHO) p(0)m \ 

m ) 

Then under Assumptions I-III 

m = 1 =*m = 1 =* n*\Z n (0)-i(T n -0)\ % 0. 

The Lemma 4 implies that v-efficiency of UCAN is equivalent to uniform first 
order efficiency. 
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Consider the test 

n*[T n -0o+A2..(0 o )] > ‘no¬ 
where a 2 = l/t(0)+A a i(0 o )+2A/)(0 o ) the asymptotic variance of the test statistic. 
Using an argument similar to that of Lemma 3, the Pitman power of the test is 

<D(a-£(l+A*)/o-). 

By tho result of Lemma 1, 

< tfi, for any arbitrary A 

<T 

or (1+A»)* < l+2A.p+A a i* 

which implies p = 1 at 0 = 0 0 (any chosen value). The asymptotic variance of 
n»[Z n (0) — i(T n —0)] is then zero, and since the convergence is assumed to bo uniform 
the desired result follows. 

The results of Lemmas 1—4 under tho conditions assumed on the probability 
density of tho observations can bo summarised as follows. 

(i) If T n is UCAN, the asymptotic variance of T n has Fisher’s lower bound 
1 /ni. This implies that tho concept of v-officioncy is not void when tho class of 
estimators is restricted to UCAN. 

It may bo noted that the existence of such a lower bound to tho asymptotio 
variance was established by Kallianpur and Rao (1955) under some conditions on tho 
estimator such as Fisher consistency (FC) and Frechdt differentiability. Recently 
(Kallianpur, 1963) relaxed tho restriction of Frcch^t differentiability to a weaker 
form duo to Volterra. Somo observations on lower bound to asymptotic variance of 
a CAN estimator have also been made by Bahadur (1960) from a different point of view. 

(ii) Uniform first order efficiency of T n implies that it is CUAN and 
v-efficient. 

(iii) The converse of (ii) has been established under the additional assumption 
that tho joint asymptotic distribution of T n and Z„ is bivariate normal and the con¬ 
vergence is uniform in compacts of 0. 

It may be interesting to examine other conditions under which the existence 
of a CUAN estimator T n with v-efficiency implies uniform first ordor efficiency. 
Restrictions on the estimator such as those imposed by Kallianpur and Rao (1955) 
and Kallianpur (1963) may be sufficient. 

The investigations of Section 4 show that u-efficiency is a valid and useful 
concept if only we restrict our consideration to estimators which are consistent and 
uniformly asymptotically normal in compact intervals of the unknown parameter. 

5. Second order efficiency 

The second order efficiency is defined in earlier papors by Rao (1961, 1962) 
as the minimum asymptotic variance of 

!.[ Zn-fi{T n -0)-y{T u -W] ... (5.1) 

when minimised with respect to y. Under some conditions this minimum value is 
equivalent to the limiting value of the difference in the actual amounts of information 
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contained in the sample and in the statistic. It was also shown (Rao, 1961) that for 
the m.l. estimate the asymptotic variance of (5.1) is the least, thus establishing its 
highest second order efficiency. 

It may be seen that the concepts of first and second order efficiencies are not 
explicitly linked with any loss function. It is also not important which function of 
0 is under estimation. We could, for instance, define first order efficiency as 

in probability for any function / admitting a continuous first derivative. Similarly 
the second order efficiency could bo defined as the minimum asymptotic variance of 

*Bn-mTn)-mi-VUlTn)-flW) - ( 6 * 2 > 

where f admits a continuous second derivative. The expression for the minimum 
asymptotic variance in cither case (5.1) or (5.2) would be exactly the same. Similarly 
if T n is alte red as 

T _i_ 

n 

where <j is a smooth function, the first and second order efficiencies remain the same 
although from the point of view of quadratic loss function there would be difference in 
terms of order (1/n 8 ). So the first and second order efficiencies as defined refer to 
some intrinsic properties of an estimator (statistic) used as a substitute for the whole 
sample for purposes of inference on the unknown parameter. 

In a discussion on my paper (Rao, 1962), Lindley thought that the superiority 
of the m.l. estimate is probably established through some specific loss function impli¬ 
cit in the definition of second order efficiency. It is, therefore, proposed to compare 
different estimators in a more direct way by assuming a quadratic loss function. 
Before doing this, the procedure has to be cleared of some unpleasantness arising 
out of some samples of relatively small frequency leading to large deviations in the 
estimator and making the expected loss unduly large. Wo shall, therefore, omit a 
portion of the sample space and compare the performance of estimators over the rest 
of the sample space. Usually the total probability of the portion so omitted rapidly 
diminishes to zero as the sample size increases and the value of the estimator over 
this portion could be defined arbitrarily except that it should bo bounded. 

We shall consider the case of the finite multinomial distribution as in the earlier 
paper (Rao, 1961). Let us represent the theoretical frequencies in the k cells by 

n x (0) . 7t k (0) 

where 0 is an unknown parameter, the observed proportions by 

Pi, ...,Pk 

and the estimating equation by 

f(0, pi . Pt) = 0 - < 6 ‘ 3 > 

m -> n ^°)) = 0 


where 



357 


CRITERIA OF ESTIMATION IN LARGE SAMPLES 

so that the estimator satisfies Fisher consistency. Wo shall assume that/ as a function 
of B, ft.ft admits third order partial derivatives which are bounded m a closed 

region P of the cube C 

0 < P< < L * “ 1 . k 

and for values of 0 satisfying (5.3) with (p v .... p t )eP. The true point n x (0) . n k (0) 

is assumed to bo an interior point of P. Let 0* bo .a solution of the equation (5.3) 

such that 0'-*0 as p 4 -nr< (0). Then expanding /(0*. j>». P.) *>y Taylor's theorem 

at 0, 7T X (0) . n k {0), we have 

gw-0)+T. ‘Up-”.) 

-T {0 '~ 0) ' Mn, - (6 ' 4) 

Due to the boundedness of the third order partial derivatives, if we define 0* arbitrarily 
in C—P, except that it should bo bounded, it follows that 

E(0*—0) = 0(n~ l ), E(t*) - 0(n-»). 

If the equation (5.3) is such that first order efficiency i9 satisfied then 

Sf ^6/ = _ 1 K 
Sn, SO in, 

as shown in (Rao, 1961) in which case, dividing (5.4) by SfjSO, tho left hand side expres¬ 
sion can be written 

0*-0-Z n (0)li 

whero Z n = Z[n' r (p r — nr,)/ir r ]. If the right hand side of (5.4) without t, divided by 
OfldO and {0*—0) replaced by ZJi is represented by S m , we have the approximate rela¬ 
tion 

0*—0—ZJi — S n . ... (5.5) 

Hence E{0*-0) ~ E(S n ) = 6(0)/n 

whoro b(0)ln is tho bias in tho estimator up to terms of 0(l/n). Such a bias has no 
effect if the mean square error is evaluated up to terms of 0(l/n). Otherwise correc¬ 
tion for bias seems to bo necessary. The correction can easily be done by considering 
the estimator 

9 = e*~m 

n 

in which the bias is o(l/n). We shall evaluate E{8—0 ) a upto terms of 0(l/n 2 ). 
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Consider the approximate relationship 

E(d')-~e+ WH. 

n 

which on differentiation with respect to 6 yields 

nE{6’Z„) ~ 1+ XM 


n 


(5.0) 


Further 
using (5.6) and 


V(8) ~ V(0*-Z m b'iO)/ni) 

~ V(0')-2b'(0)lnH 

V(0--ZJi) = VW)+ V(ZJi)- 2 cov (< 0\ ZJi) 
= VifD+X-- r(l+ 6 - ) 

m m \ n / 


V(6’)- % -X 

n*» m 


From (5.5) 

Using (5.7) we have 


= F(9)-i.. 

m 

V{0‘—ZJi) ~ V(S.) 


(6.7) 


(say) 


V(9) 


L+*B 

ni n* 


+0 (i)- 


(5.8) 


Wo shall compute ^(0) for some methods of estimation and compare the values. The 
variance of O m , without correction for bias, is 


f<o- + ...<6.9) 

m n 2 n*» \n*/ 

(i) Maximum likelihood. For the method of maximum likelihood (m.l.) 

-?- 2<* 

where W n = S(d 2 log rr f /d0*)(p f -7r r ), ? = OHi—fho)/* 

Mr. = 

The bias in the estimator and the value of iJr(Q) are 

m= S ( S .)=-^. 


iW) = "^(S.) 


nz = f^ ; -?z n )) + /<?, F(Z 2 ( 

t 4 4t 8 


^ 02 “ 2 ^21+^40_ 1 _(All-/^3o) 2 , Mil 

-i i 4 2» 4 

^(m.l.). 


( 6 . 10 ) 
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The variance of the m.l. estimator without correction for bias is 


1 

ni 


n* 


L 1 

i do 



which agrees with the expression given by Haldane and Smith (1950). It may be 
seen that ^(m.l.) is connected with £ 2 (m.l.), the index of second order efficiency defined 
in the earlier paper (Rao, 1961) by the relation 

<V(m.l.) = ®t(m.l.)+^- • 


It may be seen that the m.l. estimator corrected for bias is similar to the esti¬ 
mator given by Lindlcy (1961). For other properties of m.l. estimators reference may 
be made to papers by CraunSr (1946), Daniols (1961), Doob (1934, 1936), LcCam (1953, 
1956), ltao (1957, 1958, 1960a), Wald (1949) and others. Uniform consistency and 
convergence to normality of m.l. estimators are considered by Kraft (1955) and 
Parzon (1954). 


(ii) Minimum chi-square. A theoretical investigation of the asymptotic 
properties of minimum chi-square estimates is contained in papers by Ncyraan (1949) 
and Rao (1955). The estimating equation is 

z ”4-° 

and the valuo of S n is 

(«+ zl )+ - ' {W z - 


Wh#re 0 = g 2 ii Z - S (£ ) (Pr-*,). 

By using the expressions already derived in Rao (1961), the bias in the minimum 
chi-square estimate and tho value of #(0) are 


- 2/ L />+^u 1 

n n \2» n r 2»» J 

W) - **V{S m ) « «M-^m.l.) 

where $ = _L_S l n L\ —. Mlo 

2i* \w 9 ) + 2i 4 

which is non-negative and zero only in special cases. 

(iii) Minimum modified chi-square (Neyman, 1949). Tho estimating equation is 


(5.11) 


leading to the value of S, 
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The bias and \j/(0) are 

W) - 

n n \ in, 2i* / 

= 4*+*(m.l.). 

(iv) Haldane's minimum discrepancy ( Haldane , 1953). The estimating equa¬ 
tion, after a slight modification which does not effect the treatment of the present 
paper, is 

0 


Pr 


giving the value of S, 


-<*+»>(e+ zi)+ z -'Wrp -|u z\. 

The bias and \J/(0) are 

f_ (*+1) yn' (k+ 

n n \ 2* n r 2 » a / 

= (*+l)a*+^(m.l.). 

(v) Minimum Hellinger distance. The estimating equation is 


S _ 0 


giving the valuo of 5, 


z »- 

The bias and \J/(0) are 

#*>_ 1 /_ 1 

n nl 2» ;r r ^ 4i* J 

lW> = | +^(m.l.). 

(vi) Minimum Kullback-Liebler separator. The estimating equation is 


S log 2-0 
Pr 


giving the value of S t 


-# z -- 

The values of bias and jr(0) are 

bid) If 1 y . MsO-Pll \ 
~n n\ ~2i 2i* / 

W) = 6+#(m.\.). 
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It is seen that among the six methods compared, the mean square error in 
the estimator corrected for bias is the least in the case of the m.l., when terms up to the 
order (1/n 2 ) are considered. It may be shown more generally (following the mecha¬ 
nism developed in the earlier paper, Rao 1961) that under the assumptions made 
on the estimating equation f(0, p) = 0, the m.l. estimator has the least value for 

The bias and variance for estimators corrected for bias, obtained by the dif¬ 
ferent methods considered in this section are given below, where S and y^m.l.) are as 
defined in (5.10) and (5.11). 


variance of estimator 
corrected for bias 


method of estimation 

mas 

(coefficient of n -1 ) 

coefficient coefficient 
of n~ l of n~* 

maximum likelihood 

_ 

2 <* 

1 

t 

^(m.l.) 

minimum chi-squaro 

Is Mn+Mi\ 

2» \ 7T r I 2i* 

1 

• 

% 

<*+lfr(m.I.) 

modified minimum chi-squaro 

_ 1 y./<\ .2^-/1,, 

t U,/ T 2»* 

l 

* 

i 

4<J-f0-(ra.l.) 

Haldane’s minimum J 

discrepancy 

:(* +1 >l ( n i) + (*+!)/'«•- 
2* \ n t / 2i* 

-/'n 1 

• 

* 

(*+ I)M+^(in.l.) 

minimum Hellinger distance 

-1 

2 » l 4t* 

1 

i 

i +^(m.l.) 

minimum K.-L. separate 

-I 

2 i \» r r 2i* 

l 

i 



The expressions for bias and variance will be similar in the ease of estimation 
of parameters in a continuous distribution. The conditions to be assumed on the esti¬ 
mating equation and the probability density will be very severe if an expansion of the 
asymptotic variance up to terms of order (!/„«> is desired. A recent paper by Linnik 
and Mitrafanova (1963) on the computation of the variance of the m.l. estimator in 
a continuous case shows the naturo of the complexities involved. 

46 
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DISCRIMINATION OF GAUSSIAN PROCESSES* 


By C. RADHAKRISHNA RAO and V. S. VARADARAJAN 

Indian Statistical Institute 

Summary 

Equivalence and orthogonality properties of Gaussian processes are studied 
in a gonoral oontext and the results applied to the study of Gaussian measures on 
real Hilbert spaces. Expressions for tho likelihood ratios of two equivalent Gaussian 
measures on a real separable Hilbert spaco are derivod and tho conditions under which 
thoir logarithms are quadratic forms aro precisely doterminod. 

1. Contributions of mahalanobis 

We briofly rofor to Mahalanobis’ pioneering work in multivnriato analysis, 
specially because tho problom wo have considered is closely linkod with a distance 
function known as Mahalanobis D x introduced by him in 1925, to study the affinities 
or divergences botween populations. Sinco then there have been a number of appli¬ 
cations of Mahalanobis D x in studying the inter-relationships of groups. 

D z is a function of tho characters raoasured on the individuals of a population 
and in practice it is important to know tho behaviour of D a as the number of characters 
tend to infinity. Sinco tho number of characters studied will always bo limited tho 
classification of populations arrived at by using D x will bo stable only if D 3 converges 
to a stable value with incroaso in the nuinbor of characters. Mahalanobis (11)37) 
considered this problem and stated some conditions for convergence of D 2 ns axioms 
necessary for successful classification of populations. In a recent paper, Sneath and 
Sokal (1962) describe a similar problem and lay down hypothesos for successful classi¬ 
fication of Taxa, which aro not very different from tho axioms of Mahalanobis given 
by him twenty five years ago. 

An interpretation of theso axioms in terras of genetic factors affecting the observ- 
ablo characters was given by Rao (1954). The ideal conditions under which theso 
axioms hold and the modification noeded when the characters aro affocted by environ¬ 
ment wero also given. It was furthor shown that the effect of environment is to reduce 
tho distance (dissimilarity) between populations, a conclusion that must be considered 
soriously by Taxonomists. 

2. Introduction 

Tho simplest problom of discrimination consists in assigning an observation 
x to one of two n-variate normal populations. The discriminant function which pro¬ 
vides a dichotomy of tho sample spaco for assigning observations to ono or tho othor 
of the populations is the likolihood ratio of the densities of an n-dimonsional variablo 
with respect to the two populations. The discriminant function is linear in tho obser¬ 
vations when tho two populations diffor only in the mean values and quadratic when 
the disporsion matrices aro different. The computations involved in these cases arq 
well known and straightforward, 
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However, there often arise in practical work situations where the observations 
on an individual are of a more general nature, such as the growth of an individual 
Organism measured continuously, contour of an individual’s skull, facial profile etc. 
Each such observation provides a large number of auxiliary observations like the sizes 
of an organism at various time points and lengths of various diameters of a skull 
contour, on which finite dimensional techniques could be applied. The computations, 
however, become unwieldy if the number of auxiliary observations is large. Methods 
have, therefore, to be developed by which a dichotomy of the sample space of the 
compound observations can bo obtained in an elegant manner. Various questions 
arise in this connection. 


For a fixed number n of auxiliary observations any dichotomy of the sample 
space will lead to some errors of classification. The errors, however, decrease as n 
increases. A question then arises as to whether in a given situation the errors —>0 
as n— >co, in which case perfect discrimination between populations is possible, or 
the errors stabilize at certain values as n increases. An interesting and important 
problem is to investigate the nocessary and sufficient condition under which perfect 
discrimination is possible on the basis of a compound observation. The second problem 
is that of utilizing the compound observation in an effective way, when perfect discri¬ 
mination docs not obtain, to decide on the population from which it has arisen. Somo 
answers arc provided for both these problems in this paper. References to provious 
work are given at appropriate places. 


3. Mathematical preliminaries 

The main result in this section is a limit theorem, which enables us to compute, 
in the case of infinite dimensional distributions, the Hollinger distance between a pair 
of probability distributions. Tho limit theorem is an easy consoquonc© of the well- 
known Martingale convergence theorem. Both the theorems of this section are known 
and have been proved by Kraft (1955). We include their statements for tho sake of 
completeness. 


We denote by X an abstract space of points x and by ^ a <r-algobra of subsets 
of X. We shall bo concerned with moasures on jQ. Since only finite measures are 
important for our purposes we shall use tho term measure to denote only a finite 
measure If fi and v are two measures wo say that /i is absolutely continuous with respect 
to v n v in symbols, if ,i(A) = 0 whenever v(A) = 0; // is said to be equivalent 
to v, a v in symbols, if fi <*£ v and v ^ //. If ,t <sg v, there is a ^-measurable 
function / on X, > 0, uniquely determined v-almost everywhere, such that /i(A) 
= f fdv for all AeX3. Any such / is called tho derivative of /* with respect to v and is 

denoted by Ae/dv. ,i and v are said to be orthogonal, y. J_ v in symbols, if there is a 
set AcS such that /'(A) = «X-A)-0. In order that/,±v it is sufficient that for each 
£ > o there should exist a .set B, with e^and «X-B.) < «; m fact if A„ .8 

the set B, with e = 2-* and we write A = Q, U/*. then M) = v(X-X) = 0. 
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If n is a measure on 8, f a /c-intcgrablo function on X, an<l & a rr -algebra 
included in tho conditional expectation of/given & under //, in symbols, 

is any 4?'-measurable function /' such that J f'd/i = \Jd/t for all AcS'. From this 

it follows at once that if v is a measure on & such that v //, and v\ //' aro the respec¬ 
tive restrictions of v, // to X?', then dv'Jd/i = E^dv/d/i | XJ'). 

Supposo now p and q arc two measures on Let A be any measure such 
that p A, q ^ A (such measures always exist; for instance, A = p+q). We 
write / = dp/dA, g = dq/dA, and define 

h lP> 9) = J (foW*- 

The function h has many interesting properties. Before discussing some of these wc 
first remark that h(p, q) is independent of the A used in defining it. In fact let us 
write hx(p, q) for tho intogral \{fg) k dA. Supposo A' is another moasuro with p C A' 
and q ^ A'. If wc write //= A-f-A', then hjp, q) = J (dp/d/i . dq/d/i)*d/i -» 
J (dp/dA.dq/dA)* dA/d/t.d/i = A x (p, *7); and. by a similar reasoning, h H (p, q) = h x ’(p. q). 

We denote by the set of all probability measures on Q. If p, q ey> wo 
shall call h{p, q) tho Hellingcr distance between p and q. Even though h is not a dis¬ 
tance function over J3, (I —/*)* is a distance function, thus providing a partial justi¬ 
fication for our nomenclature. Tho consideration of h goes back to Hellingcr (11)09). 
Obviously h(p, q) > 0. Wc write U(p, q) =— log h{p, q). 

Theorem 3.1 : (i) 0 < h(p, q) < 1 for all p, qej* (ii) if S’ is a a- algebra CX? 
and p\q' are the restrictions of p.q respectively to then h{p,q') > h(p, q). (iii) 
(1—A)» is a distance function over 73 (iv) h{p,q) mm 0 if and only if p_[_q. 

For the proof tho roader may refer to Kraft’s paper (1955). 

Remark : Since 0 < h{p, q) < 1 for all p, qeT’, 0 < H(p, q) < 00 . //(/>, q) = co 
if and only if p | g. 

In many applications X is usually a space of functions and consequently 
computation of h becomes difficult. In such situations it often happens that the 
measures on & are built up from measures on certain sub <r-algebrns of The 

following theorem examines this set up. 

Theorem 3.2: Let C ••• £ O-- be an increasing sequence of sub - 

c-algebras of £ such that & it generated by \J Let p, q be tivo probability 

sures on & and p n , q n their respective restrictions to Then 


mea- 
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Proof: Let A = p+q and A„ the restriction of A to & n . Let / = dp/dA and 
0 = dq/dA. Wo then know that dpJdA m = Ex(f\S n ) and dq n /dA n = E x (g\ & n ). 
Write /„ = dpJdA n and g n = dqJdA n . Clearly 0 ^ /, g,f n , g n < 1. By the Martin¬ 
gale convergence theorem / n —> E(f\ &) = f A-almost everywhere and g n —>g A-almost 
everywhere. Since 0 < (/„£„)* < 1 for all n it follows that h(p n , q n )—> h(p, q). The 
decreasing character of the sequonce h(p n ,q n ) follows from Theorem 3.1. 


4. Gaussian processes 

Wo shall now apply the results of the preceding section to the study of a pair 
of Gaussian processes. Suppose {5 a : aeT) is a collection of random variables on 
X such that & is the smallest cr-algebra of subsets of X relative to which all the 5 a 
are measurable. A probability measure p on & is said to bo Gaussian relativo to tho 
5 a if for any k and a lt .... a k e T, the joint distribution of 5«i •••. 5a*>» a normal dis¬ 
tribution. 

A typical and oxtromoly useful class of examples is obtained when we take 
X to be a vector space over tho reals and 5a to bo a collection of linear functionals 
over X closod under tho formation of linoar combinations. Defining & to bo tho 
sraallost <r-algebra of subsets of X with respect to which all tho 5 n are measurable, 
wo find that a probability measure p on is Gaussian if and only if each 5a has a 
normal distribution undor p. Two special cases are of groat importance in tho appli¬ 
cations of our theory. 

In tho first example X is a real separable infinite dimensional Hilbert space 
and for each aeX, 5a is tho linoar functional x— *(a, x) of X. & is then tho class of all 
Borel subsets of X. If p is a Gaussian measure on J3 then there is an element meX 
and a linear operator A of X such that E p { 5J = (m, a) and cov p (5 a , 5„) = (Aa, ft) 
for all a, ft e X. m is called tho mean of p and A tho dispersion operator of p. A is 
self-adjoint, non-negative dehnite and has finite trace, m and A uniquely determine 
p and to each me X and self-adjoint, non-negative dofinito operator A with finite 

trace there corresponds a p.[cf. Prohorov (1956)]. In this case if a x , a . is any 

sequence in X whose linear combinations are donso in X, & is generated by sets of tho 
form 5" 1 (£) (B a Borel set on the lino), and a measure on ^ is Gaussian if and only 

if tho joint distributions of the 5«« normal. 

In the second example X is the space C(a,6] of all continuous functions on [a, b) 
and & the class of Borel subsets of X. For each signed measure a on [a, b] 5 a tho 

linear functional J x(t)da(t). A measure p is Gaussian if and only if for all k 

and all .... t k e[a, b), the joint distribution of & a ,« normal, where for 
any t e \a, 6], 5, is the functional x->x(t). If p is Gaussian we can define »«(/) = E p ( 5,) 
and K(s, t) = cov p (5„ 5,). m e X and K is a symmetric function continuous in both 
variables, m is called the mean and K the covariance function of p. 
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Denote by X the Hilbert space of all functions a: on [a, 6] with J \x(t)\ 7 dt < co. 

There is an obvious inclusion XQX and it is easily seen that measures on X can bo 

regarded as measures on X. Even though the topological structures of X and X are 
quite different this difference does not play any significant role in our applications. 

For any measure p on 8 we may denote by J> the corresponding measure on X. The 

correspondence p^p preserves absolute continuity and hence equivalence and ortho¬ 
gonality. If p is the Gaussian measure with mean m and covariance function X, the 

measure p is Gaussian in the Hilbert space X. m is still the mean of jrwhile the dis¬ 
persion operator of p is the (integral) operator x-* Ax whero (i4x)(0 = j K(t, u)x(u)du 

for all /. A classical example is the Wiener measure with mean m and varianco para¬ 
meter e. It is the Gaussian measure on C[0, 1) with mean m and K(s, l) = 
c min (s, t) for s, t e (0, 1J; hero c > 0 is a constant. 

It is a consequence of the early work of Cameron and Martin (1944, 1945) 
that if one considers on the spaco C(0, 1) tho two Wiener ineasuros with means tn x 
and and tho same variance parameter c >0, then tho two measures are either equi¬ 
valent or orthogonal and that equivalence is obtained only if m x —m t is sufficiently 
smooth. On tho other hand, if tho means are samo and the varianco parameters 
arc different, then the measures are always orthogonal. These problems wore oxamined 
by Segal (1958) in a very general context whero ho obtained necessary and sufficient 
conditions for equivalence. 

Following up those results it was proved by Feldman (1958) and Hajek (1958) 
that if two probability moasurcs aro Gaussian relative to the samo set of random 
variables, then they aro cithor equivalent or orthogonal. Necessary and sufficient 
conditions for equivalence wore also obtained by theso authors. 

Our concern in this section is also with a pair of probability measuro p x and p 2 
which arc Gaussian relative to the same set of random variables. If the two means 
aro m x , m 2 and tho dispersion matrices are A x , A,, wo obtain conditions for equivalonco 
in terms A|, A 2 , m x and m 2 . In view of the results of Foldman and Hajek it is enough 
to determine conditions for orthogonality and this is dono using the Hollinger distance. 

Wo now introduce the notations which we shall adhere to throughout tho rest 
of this section. X is an abstract set, & a <r-algobra of subsets of X and £ |( £ s , ... is a 
sequence of random variables on X such that /Q is the smallest cr-algobra of subsets 
of X-rclativc to which all the are measurablo. We denote by tho smallest 
cr-algebra relative to which .... are measurable. A probability measuro on & 
is called Gaussian if it is Gaussian relative to tho {£;„ : n = 1, 2, ...}. If p is any 
Gaussian measure we can form 


”b<P) = *&) 

A**(p) = cov,(^, Z k ) 
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W e denote by m(p) the sequence (m x (p), m. 2 (p), ...), called the mean of p, and by A (p) 
the ,nfin,te matrix For any integer n > 1 we write A n (p) for the nxn 

matrix (A jk {p)) l < j k < n . Clearly A„(p) is the dispersion matrix of (5 If .... £ n ) under 
A (p) is called the dispersion matrix of p. We shall say that p is non-singular 
if | A„(/>)| 0 for any n (for any matrix C we write \C\ for its determinant). 

A typical example of our considerations is obtained when X is the space of 
all sequences x = (r„ x 2 , ...) of real numbers and for any n, $ n (x) = x n . & is the 
smallest cr-algebra of subsets of X relative to which all the are measurable. If 
m = (m„ m 2 , ...) is any sequence of real numbers and A = (A jt ) any infinite matrix 
such that A„ is positive definite for each n, there is a unique Gaussian measure on & 
with mean m and dispersion matrix A. We shall denote this measure by p(m, A). 
p(m, A) is clearly non-singular. 

Suppose now that p x and p 2 are two non-singular Gaussian measures on 
Wo write mj = m(p f ) - (m JV m Jt , ...) and A, = A ( Pj ) (j =, 1, 2). Wo define 

4 = *n lm —m 2H n - 1, 2,... 

*-(4,4,...) 

and 4 = (4.4.4)- 

Wo next introduce tho matrices 

A — $ ( A i+A t ) 

A» ™ i ( A ii.+A 2n ). 

Wo introduco tho quantities 

Pn = 2 log | A„ | —log| A ln | —log| A 2 „ | 

= «y n A" , <5„ (for any matrix C, C* denotes tho transpose of (7). 
is the well-known Mahalanobis D 1 between two distributions in n-spaco having mean 
difference 8 n and the same dispersion matrix A„. Finally we write p ln and p 2n for 
tho restrictions of p x and p 2 to /3 n . Wo recall that / 3 n is tho smallest <r-algobra with 
respect to which •••» 4 are measurable. 

Theorem 4.1 : For each n) I, we have 

H{p ln ,p 2 n) = p n +^D*. 

The sequences {p n } and {D^) are both non-negative and monotonic non-decreasing ; and 
if we write p* = lim p n and = lim D%, then 

n—>CO n—> CO 

H(p lt Pi) = 

In order that p x = p 2 it is necessary and sufficient that p* < co and /)«> < co i.e., 
the sequences {p n } and {Dl} be bounded. In other words p x and p 2 are equivalent if and 
only if( i) the Gaussian measuresp{0, A,) and p( 0, A 2 ) are equivalent and (ii) the Gaussian 
measures p(m x , A) and p{m 2 . A) are equivalent. 
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Proof: If p[ n and p 2n are the distributions (in n-spaco) of (5|. •••. Sn) under 
Px and p 2 respectively, it is easy to see that h{p ln , p 2n ) = h{p\ n , p 2n ). Using the 
formulae for the densities of p\ n and p' 2n and applying standard techniques of computing 
multiple integrals we obtain the formula for H(p lm , p 2n ). In view of Theorem 
3.1 wo know that H(p ln , p 2 *) ^ 0 and increases with n. 

Substituting in the formula for U(p\ n , p' Sn ) the values m u = m 2< = 0 for 
t — 1,2,.... n we see that ^p H is the Hellinger distance between the n-dimcnsional 
distributions of p(0, A,) and p( 0, A 2 ). Part (ii) of Theorem 3.1 now enables us to con¬ 
clude that />„ > 0 and increases with n. Similarly * D\ is the Hellinger distance 

between the n-diraensional distributions of p(m v A) and p(m. it A). Consequently 
D\ ^ 0 and increases with n. 

Theorem 3.2 now applies to give the result that PxX.Pi and only if 
H(px n , P 2 „)—*'X> i.e. if and only if cither — <x> or D%, = oo. Since either p x J_p 2 or 
Pi ai p 3 we may conclude that p x u p s if and only if />«* < co and D < co. 

Finally using the same arguments we conclude that - = H{p(Q, A,), /)(0, A 2 )) 

nnd 1 = A), p{m 2 , A)). This implies immediately that p x s- p 2 if and 

only if p(0, A,) -a />(», A,)and p(m t , A) m p(m t , A). This completes the proof of tho 
theorem. 

Corollary : // A l = A 2 , then p x m p t or p x I p 2 according as lim S n A“* 6*, 

■ -♦co 

< co or = 00 . 

Remark: Kraft (1053) also computes //(/>,„, p im ). The formula which he 
derives is not howovor in the same form as ours. 

Wo shall now examine more closely the conditions under which p ^ < co. 
Since A ln and A 2n arc, for each n, positive definite matrices, there exists a non-singular 
matrix S n such that 

= /„ 

S n A tn S‘ H = L m 

where /„ is the nxn unit matrix and L n is a diagonal matrix. Let A nl , A nl .A„ 

be the entries of L n . It is known that they are the roots of the equation (in A) 

|A*,-AA lfl | =0 

and that they can also bo determined as the eigen-values of the positive-definite 
matrix Af l> »A 2n Af„». In particular A ni > 0 for all n and i. 

Theorem 4.2 : With the above notation, 

p n - E (2 log (l-fA^)/2-log A ni ). 


47 
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in order that /><* < co it is necessary and sufficient that there should be positive constants 
c, C, M such that 

(a) 0 < c < A ni < C < co for all n and i 

(b) £ (A n< — 1 )* ^ M < oo for all n. 

Equivalently, p^ < co if and only if there exists a positive constant M' such that 

£ (A< A/' < oo for all n. 

Proof: From tho formula 

Pn = 2 log | A„ | —log| A lt , | —log | A tn | 

it is clear that p n remains unchanged if wo replace A ln and A 2n by S n A ln S‘ n and 
S n A 2n respectively. The expression for />* in terms of tho A n< follows at once. 

n 

Suppose now there exists a constant M' > 0 such that £ (A„,— 1 )'IK> < M- 

<co for all n. Rewriting 2 log(l -fu)/2 —log u as log (1 -fu) f /4u and using tho inequality 
log (l+t>) < v for v > 0 we get 

Pm — log [1+(A W< — 1 )*/4A wi ] 


< £ (AM-1JV4A 

M 


Thus pa < co. 

Conversely, let us suppose that p M < co. This means that p n < M" for all 
n, M" > 0 being a constant. Since (l+a) ! > 4a. we have, 2 log (l+A„,)/2-log A nl >0 
for all n and i and hence 2 log (l+A„,)/2-log A„, < M" for all n and i. Since 
2 log (1 + a)/2—log a—> oo as a-* Oand as a-»oo it follows that there are constants c > 0 
and C > 0 such that 0 < e < A„ ( < C < oo for all n and i. But then 
log A ni —2 log (l+A„,)/2 = log 4A„(/(1+A„,)* 

= log(l-(A. j -I)*/(A.,+ l)*) 

< _(A„,-1) ! /(A„,+ 1) 2 (since log (1—<) < -t for 0 < t < 1) 




so that 


Pn > 
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Consequently, if M' = M" — » 

E (A b4 -1 m mi < M' < co 

<-i 

for all n. Thus the finiteness of p m is equivalent to the bounde<lncss of E(A ni — 1 )*M«e 

Now if 0 < c < A n4 < C < oo for all n and i and if E (A b4 — l) 2 < M < co for 

all n, wo see that E(A n4 —1 )*/A ni < M/c < co so that we may concludo that p, < co. 
i 

On tho other hand, if p w < co, the analysis in tho preceding paragraph shows that thoro 
constants c, C > 0 such that 0 < c < A ni < C < co for all n and * and that E(A„ 4 — 1 ) 2 

remains bounded as n increases. The proof of tho theorem is completed. 

It follows from Theorem 4.1, that tho Gaussian measures p, and p 7 aro 
orthogonal whenever Z)|o = co. It is interesting to remark that this result remains 
true even if p, and p 2 are not Gaussian. In fact wo have 

Theorem 4.3 : Ltt p x and p 2 be two probability measures on £ and let 5i. 5a-•• 
be a sequence of random variables having finite second moments under both p, and p 2 . 
Let 

*n = m ln — m 2n> = (<f|. ... 

and let A x and A 2 be the dispersion matrices and A = A (A, +A 2 ). If D 2 = <$„ A” 1 <$* —►co, 
then p, p 2 . 

Proof: Clearly it is enough to prove that for oach e > 0 there is a sot B, 
with p,(Z*,)+Pa(^— B t ) < e. We shall construct, for each n, a set B„ such that 
Pl {B n )+p 2 (X-B n ) < 8/Z> 2 . Sinco D*->oo, this will show that p, J_ p 2 . 

Considor now, for a given n, £ lt .... Lot S bo a non-singular matrix with 
ontries s )k such that S A ln 5* = / and S A tn S* = L whoro / is the n x n unit matrix and 
L a diagonal matrix with ontries A„ .... A.. Tho A’s aro all > 0. Define = E s Jk % k . 

Then rj lt ..., q, aro uncorrelated under both p x and p r Write now 

a i = R v\ ( 7 >). = E Pi cj = aj—bj 

and define c = (c„ ..., e B ). We have the equation S n = c.(S-*)* so that 

D* = « 

= c.(S‘)-'A;' S c* 

= c.(SA b 5*)-». c* 

= c.(/+L/ 2 )->. c* 

= 2 E cj/(l-f A^). 
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Let — CjKl+Aj) and write a = E r } a } and b = S rf> y We may assume a < b 

(since the case whore a > b can bo reduced to this by interchanging p x and p 2 ). Let 
B n be the set defined by the inequality 

'ifi+.-.+r.?. > («+6)/2. 

Since this is equivalent to o„) > (b—a)/ 2, and since var p ,(fy) = 1 

for all j, we have, by Chebyshov’s inequality, 

*,<*■> < 4 2 r}/(6-a)*. 

Using a similar argument and remembering that var Pl (j;,) = A j for allwe get 

p t (X-B n ) <42 tjXfKb-a)*. 

Since b—a = S j c5/(l+A j ), wo obtain 

Pi(B m )+l>4X-B m ) < 4[Ztf/(\+ A^/lS^l+A,)]* - 8/D*. 

As observed earlier, this proves that P\\_p 2 and finishes the proof of the theorem. 


5. Gaussian measures in Hxlbbrt space 

Wo shall examine in this section questions relating to Gaussian measures in 
a real, separable infinite dimensional Hilbert space X. HA is the dispersion 
operator of a Gaussian measure with mean m, it is clear that for any we X with 
( Au , u) = (i4*w, A*u) = 0 the entire mass of the measure is concentrated on the sot 
{a: :(x, u) = (m, w)}. Since only elementary arguments are needed to take care of such 
situations, wo shall systematically consider only those A for which A*u does not vanish 
unless u = 0. Such A we shall call non-singular. Since A is non-negative definite, 
A*u = 0 if and only if Au = 0. We introduce the partial ordering < in the 
set of all self-adjoint operators in X, A < B if B-A is non-negative definite 
(denoted by B—A > 0). For any operator A we write R(A) for tho rango of A i.e. 
R{A) = {Au : ue X). 


Let now p x and p 2 be Gaussian measures on X with means m x and »n 2 and disper¬ 
sion operators A 1 and A 2 , which we shall assume to be non-singular. We write 
A — |(A 1 +A t ). It is easily seen that A is also non-singular. Let us write 8 = m l —m r 
We now have the following theorem. 

Theorem 5.1 : In order that p, = p z » is necessary and sufficient that both 
the following conditions be satisfied : 


(a) SeBl A*); 

(b) there exists a bounded self-adjoint operator T such that (.) T > k.I for 
some constant k> 0 (ii) tr IT-I? < co (iii) A, = AfTAf. 
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Proof: We know from Theorem 4.1 that in order that the equivalence 
p, *= p, hold it is necessary and sufficient that (I) the Gaussian measures will. means 
and in, and dispersion operator A are equivalent and (II) -he Gauss,an n.easures 
with means 0 and dispersion operators A, and A : are equivalent. We uhi.ll prove 
now that (a) is necessary and sufficient for (I) and (b) is necessary and sufficient for 

(II). 


Lot P„ be the projection on the spectral subspaco X. of A corresponding to the 

interval [-, oo] on the real lino. Let pi and pi be the Gaussian measures with means 

m, and m,"and dispersion operator A and let pi. and pi„ be their projections on X„. 
These are equivalent since X. is finite dimensional and is non-singular. Since they 
have the same dispersion operator A. - P.AP. wo have, after a direct computation. 

*<?>;.. ri.> - 4< a «" 


where S n = P H S. In other words, in order thst the first equivalence holds it is no CO* ary 
and sufficient that ||A-*<SJ | 8 »tay bounded as n increases. Let a n eX n he such that 
A*a„ — S n . Since X„ is a spectral subspaco of A, P H commutes with A* and hence 
A*a„ = d n . Wc shall show that ScR( A») if and only if ||<x,|| remains bounded as n 
increases. For, suppose ||<xj| < C < oo for all w. Then there exists an aeX and a 
sequence n, < w a <... such that (wt n ». u)—*(a, u) for all ueX. .Since A* is symmetric, 
(A*/?. ii) — (/I, A*ti) so that (A*a„». u)-*(A» a. «) for all u e X. But A*Jt.. t =• S„ k and 
6„ k ->6 and *->oo. Thus A«ac - i proving that a c R( A*)- On the other hand, if 
there is an a € X such that A*a - 6, then the fact that P n commutes with A* implies 
that A *P n a = $ n and hence that a n =• P n a. Thus a„-> a. and hence ||aj| remains 
bounded ns n increases. 

Wo now take up the second equivalence and show that for this to hold (b) 
is necessary and sufficient. Let us denote the Gaussian measures with means 0 . and 
dispersion operators A, and A 2 . by q x and q 2 . Since Af* has a dense domain wo can 
find an orthonormal basis q, < t , ... for X such that f, lies in the domain of Af* for 
all n. Lot Z, n be the linear functional x-*(x, A 7 1 e„). Write 

t mn = (A a Ar» *•„. A 7 * e.) 
t'wm — tmn—timn (Kronecker delta) 
and T n bo the matrix (fft)i < i, j < *. Moreover we have 

cov Pl {l m , £„) = S mn 
cov Pl a mt Z, n ) = t mn . 

Now tho linear combinations of tho vectors Af *c n are dense in X and hence 
wo may conclude that the class of Borel sets in X are generated by sots of the form 
Sn 1 ^) (Y a Borel set on tho line). Theorems 4.1 and 4.2 now apply and onablo us 
to conclude that the measures q x and q t arc equivalent if and only if ( 1 ) there exist 
constants k and K such that 0 < k A* t < K for all n and * and ( 2 ) there exists a 
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constant K' such that £ (A Bi —l) 2 < K' < co for all »; here A^, ( .... A' B are tho eigen¬ 
values of T n . These conditions are obviously equivalent to (!') k • I„ < T n < K.I n 
for all n and (2') tr(T n —/„)* ^ K' < co for all n, /„ being the nxn unit matrix. Wo 
shall complete the proof by showing that these are equivalent to (b). Suppose there 
exists a T satisfying (b). We have, (Te it e f ) = (Af* T Af * e it Ap*e,) = (A 2 A 7 * e { , 
Ar* tj) = ty. Hence (T' 2 e it e t ) = (T'e it T'e { ) = £ /JJ where T'= T-I. Since tr(T' 2 ) 

< co E (T' 2 e it e t ) < co and hence £ E t',f < 00 . This shows that tr ( T n —I„ ) 2 = E 2 Q 
i it 

remains bounded as n increases, proving (2'). On the other hand, T > k.I so that 
{Tu, u) > k(u, u ) for all it. If we consider this for all u in the subspace spanned by 

e,.e n wo can deduce that T n > k-J m . Since T is bounded, T < K I for some K 

and by an argument similar to the one just given we conclude that T n < /£•/„• This 
proves (T). Suppose conversely that (1') and (2') are satisfied. Since tr(T n —7 n ) a 
= E £ ttf, (2') implies that E £ t',? < co. Hence there exists a bounded operator 

i.J*n i t 

T' that {T'e it e t ) = t' fi and £ (T*e it T'e t ) = E E I'J < co. Evidently T' is self-adjoint 

and hence T ' 2 > 0 showing that tr T' % < co. Write T = T'+I. Then (Te t , e,) = t tJ . 
Since k-I n < KI n for all n, k(n, u) < (Tu, u) < K (u, u) for all u which are finite 
linear combinations of the e/s. This proves that k-I < T < K.I. Finally 
([A{ TAf] Ap* e { , Af» t s ) = {Te { , e,) = t tJ = (A 2 Af* e { , Af* t s ), so that if .r and y are any 
two elements in the linear manifold X' generated by the Af * e f , (A|7'A| x, y) = (A 2 x,y). 
Sinco X' is dense in X, we can conclude that A a = A}TA|. This proves that (b) 
is implied by (1') and (2'). As observed earlier this completes the proof of the fact 
that tho Gaussian measures with means 0 and disporsion operators A, and A 2 are equi¬ 
valent if and only if (b) is satisfied. Taken with the earlier proof that (2) is necessary 
and sufficient for the equivalence of tho Gaussian measures with means m x and m 2 
and dispersion operator A, this proves tho entire theorem. 


Remarks: (1) It may bo noticed that tho condition (b) is not symmetric 
in A, and A a . However this is only an apparent difficulty. In fact one can show 
that if (b) is satisfied, there exists an operator S, bounded and self-adjoint, such that 
(i)£ ^ k'-I for some constant k' > 0 (ii) tr(5— I) 2 < co (iii) A^SA^ = A v In fact 
q = AjT* is a bounded operator and QQ* = A 2 . so that using the polar decomposition 
of Q and the fact that A| has dense range, we deduce that Q = AJ U whero U is 
unitary. Thus A* = A{C/T-* and consequently we have A, = A \UT~'U- l Al Sinco U 
is unitary and k.I < T < K.I S = UT ~»is a bounded self-adjoint operator 

with S > — • /• It is easy to conclude from T > k.I and tr{T—I) 2 < co that 

tr( y-i_/)« < co so that tr (S—/) ! < co. Obviously Aj SAj = A,. 

(2) It might be noticed that throughout the proof of Theorem 5.1 only super¬ 
ficial use has been made of the fact that A, and A, have finite trace. This is not due 
to accident. The point is that if A, and A, do not have finite traces, even though there 
are no Gaussian measures with these as dispersion operators, there nevertheless e«st 
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Gaussian weak distributions (in the sense of Segal (1958)) with dispersion operators 
A, and A a and the conditions (a) and (b) of Theorem 5.1 are necessary and miffieiont 
for the equivalence of the Gaussian weak distributions with means m, and m* and dis¬ 
persion operators A, and A r The proof of this needs only trivial modifications in the 
proof of Theorem 5.1. In fact our proof that (b) is noccssary and sufficient for the 
equivalence of the Gaussian distributions with moans 0 and dispersion operators 
A x and A 2 does not use the existence of tr(A,) and tr(A 2 ) and hence goes ovor without 
changes. On the other hand, in the proof that (a) is necessary and sufficient for tho 
equivalence of the Gaussian distributions with means m l and m 2 and dispersion opera¬ 
tor A, tho only place where compactness of A is used is in deducing that tho spoctrnl 

subspaco X n of A corresponding to[ ooj is finite dimensional which in turn loads to 

tho finitoncss of H{p\ n , p' 2n ) and to the formula U(p\ n , p in ) = g IIA“ * JJI*. If A 
is not compact we may reach tho same results by arguing differently. Notico that 
ovor X„, A_ > -• I so that A* has a bounded inverse thereon. It can bo easily shown 

in this case that H(p[ m , p 2n ) is finite and equals ||A“ * £„||*. The rest of the proof 

ncods no chango. 

(3) It can bo easily verified that condition (b) is equivalent to tho condi¬ 
tions of Feldman (1958) in tho special context of Thoorem 5.1 when rn t and w a aro 0. 
Feldman's mothods aro howovor somowhat different from ours. 

(4) If A a = cAj where c > 0 is a constant, then it follows easily from 
Thoorem 5.1 that the Gaussian weak distributions (moans arbitrary) with dispersion 
operators A x and A 2 are orthogonal whonevor c # 1. This generalizes tho classical 
result concerning Wiener measures. 

(5) If A is tho intogral operator *(/)-♦ J K(t, u) x(u)du where K (s, t) — 

min (a, t) 0 < s, t < 1 , thon it is a routine computation to obtain tho eigen-values 
and oigon-functions of A. It can thon be proved oasily that an xeC[0, 1] lies in 
I?(A*)(A is considered in L a (0, 1)) if and only if x is absolutely continuous and 

J | x'(t) 1 2 dt < co, x' being the derivative of x. In other words, the Wiener measures with 
o 

the snmo variance parameter and difference 6 in means aro equivalent if and only if <5 
is absolutely continuous and S'eL t {0 , 1). 

6. Likelihood ratios 

In the preceding sections we have been examining the conditions under which 
two given measures are equivalent or orthogonal. From the point of view of discri¬ 
mination the case when equivalence obtains is the nontrivial one and there arises 
the important question of deriving the expressions for the discriminant functions. 
Mathematically, if p x and p t are the Gaussian measures, the problem is that of com¬ 
puting the logarithm L of the likelihood ratio dpjdp t as a function on the sample space. 
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We shall study this question in this section. We shall restrict ourselves to a concrete 
situation, namely "’hen the measures are defined on a real separable infinite dimensional 
Hilbert spaco X. Some such restriction seems necessary if one’s aim is to exhibit an 
explicit formula for L. It would be of interest to obtain the form of L in other 
concrete situations. 

In the case when X is finite dimensional, as soon as the dispersion matrices 
are nonsingular, the Gaussian measures in question are equivalent and it is easy to 
write down L. Except for an additive constant, L is a linear function if the disper¬ 
sion matrices are identical while the general case leads to an L which is quadratic in 
the observations. The situation is somewhat more involved in the infinite dimensional 
case. The reason for this is that in an infinite dimensional vector spaco linear and 
quadratic functions are not well-behaved unless one imposes certain topological 
restrictions on them. Thus, even though it is true that L can be regarded as a qua¬ 
dratic function nearly always, it will not in general be the quadratic form associated 
with a reasonably woll-bchaved linear transformation. Theorems 6.1, 6.2 and 6.3, 
which describe the precise conditions under which L can bo associated with well-behaved 
analytic objects in the underlying Hilbert space and exhibit the expressions for L 
undor these circumstances, aro the main results of this section. 

It is a gonoral feature of all the known results on likelihood ratios that the compu¬ 
tations aro made on finite dimensional distributions and the final results obtained by 
a passage to the limit. Such a method runs into difficulties when the Gaussian measures 
on the Hilbert spaco have different dispersion operators mainly because the inverses 
of the dispersion operators are unbounded in the Hilbert space. So far as wo aro 
aware there have beon no formulao of significant generality for these likelihood ratios. 
Wo shall, in this section, give one such general formula. It is of interest to point out 
that wo do not rely upon the method of finite dimensional approximation but use a 
more direct argument. 

Throughout this section X denotes a real separable infinite dimensional Hilbert 
space. By a dispersion operator in X we mean a linear operator A > 0 with finite 
trace; p x and p 2 denote Gaussian measures with means ffi„ m 2 and dispersion operators 
A, and A 2 respectively. We write, as usual, m = *(**»+m,) and A = J(A 1 +A 2 ). 
Wo shall always assume that A, and A a are nonsingular as in Section 5. 

We shall first examine the case when A, = A 2 = A. The results are known 
(Grenandor, 1952) but we give a discussion of this case since it serves to introduce 
our point of view and prepare the ground for the more difficult case when A x # A 2 . 

Suppose then p x and p 2 are Gaussian measures with means m x , m 2 and dispersion 
operator A. Wo assume that p x ^ p t . In view of our results in Section 5 this means 
that 5 = 7 /i. — m 2 ei?(A 4 ) and hence that || A“» S ||* < «>. If we write L = log (dpjdpj 
then Ltx) = L\x-m 2 ) where V = log (dp'Jdp't), p[ and p' t being Gaussian measures 
with means S and 0 and dispersion operator A. To compute L‘ wo may proceed as 
follows. Since A is a nonsingular dispersion operator we can find an orthonormal 
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basis «„ «„ . .. for X such that for each n Ac. - A.c.. A. > 0. Write = A/*<*. «,)• 
Then £ a , ... arc indopendent under both p\ and p t and wo m\o 
L\x) = lim L' n (x) for almost all a: whore L' n is the logarithm of tho likelihood ratio o 

the restrictions of p\ and p t to tho smallest <r-algcbra with respect to which .... 5. 
are measurable. It is easy to chock that 

L’ n (x) =-A**(A"» 6, c k Kx, 'k)-h£ t (A” 1 *. f *>*- 

The second term converges to ||A“* <5|| a . The first term consists of indopendent sum- 
mauds with means 0 and variances (A*<5, c*) a , (k = 1,2,...) under p\, and since 
E (A-*$, e k ) 2 < co the first term converges almost surely. Hence wo have tho expres- 

k 

sion L’(x) = 2 (A~*«5, «*)**(*)- for Since each E* is a linear function 

it is reasonable to regard L‘ as a linear function on X. However L' is defined for almost 
all x and in general cannot be extended to X as a continuous linear function. Wo 
shall say that log dpjdp t ) is linear if there exists a continuous linear functional 
y on X and a constant c such that L(x) ~ y(x)+c for almost all x. 

Theorem 0.1 : Let />, and p t lx equivalent Gaussian measures with means 
m, and m, and dispersion operator A. In order that L — log dp x jdp i be linear it is 
necessary and sufficient that 6tft( A) where 8 — Wj-Wj. In that case . 

Ux) = (*. A-‘i)—(m„ A-M)-i(A, A-‘i) 

/or almost all x. 

Proof : Let us first assume that 8cR(A). Then 
(x, A -*i) - 2 (A-‘rf. <*) 

* 2 (<*. A- 1 e*)(x, c a ) « 2 A* 1 ( 8 . e*)(x, <•*) 

and consequently L'(x) (x, A”‘£)— ^l|A~* «5|| a . If wo recall that L(x) = L\x—m t ) 

and note that ||A~* $|| a = (£, A _l £) we obtain tho expression L{x) = (x, A -1 8) 
—(m„ A->i)-i(i, A-‘ «). 

Conversely, lot us assume that there exists a continuous linear function y 
and a constant c such that Ux) = y(x)+c for almost all x. Then Z/(x) = L{x-fni 2 ) 
=y(*)+c' where c‘ is another constant. There existsyeX such that L'(x) = (x, y)+c'. 
Now for any u in X . tho joint probability distribution v under p t of ^ and i) where 
E(x) = (x, m) and y(x) = (x, y) is Gaussian with means zero and dispersion matrix 
V where 

v= /{Au,u) (A u, y) \ 

\ (A ti, y) (A y, y) ) 

and sinco 

J oxp [(x, y)+i(x, t i)W*x) = J exp ( 9 +U)dv(^ y) 

48 
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wo conclude on the basis of an easy computation that the integral on the left side exists 
and is equal to exp [-1 (An, «)+ * (A y, y)+i(Ay, «)]. Putting u = 0 we sec that 

J exp [(x, y)]dp' 2 (x) = exp [i (Ay, y) j ; 
since L' = log dp'Jdpi, we have 

J exp [L'(x)]dp 2 (x) = 1 

so that L'(x) = (x, y)— (A y, y). The equation 

/ exp [(x, y)—i(A y, y)+i(*, = exp [ - i(A u, w)+i(A y, u) ] 

now tells us that p\ is a Gaussian measure with mean Ay and dispersion operator A 
and consequently that S = Ay. This proves that SeR(A). The proof of the theorem 
is now complete. 

Wo now proceed to the general case when A, ^ A 2 . In discussing this case 
wo shall first assume that m, = m t = 0. Lot p, and p 2 bo Gaussian measures with 
moans 0 and dispersion operators A, and A, respectively. In view of our results of 
Section 5 there exists a bounded self-adjoint operator S with S > hi for some constant 
k > 0 such that A, = A J 5 A{ and tr (8—1)* < oo. Let e t , e t , ... bo an orthonormal 
basis for X such that A t e n = A n e n for all n, A„ > 0 being a constant. Write / n =A“*c n , 
5„(x) = (x.f n ). Then ... arc independent with means 0 and variances 1 under 

p 2 while they have means 0 and covariances s k , = (Se k , e,) under p x . Since S has a 
pure point spectrum there is an orthonormal basis g v g t ,... of X and constants 
8 lt s 2 , ... > 0 such that Sg n = s n g m for all n. Write g i = £ a Jk e k and Tj f (x) = £ a Jk Z, k (x). 

Since £ (o Jk ) 2 < co, Vj * 8 finite with probability ono under p 2 and hence under p x 

also. Moreovor the orthonormality of g lt g 2 , ... implies that rj 2 , ... are indepen¬ 
dent with means 0 and variances 1 under p 2 . On the other hand covp, (//*, tji) 
« £ a* a„ s rl = £ a kr a„ (Se r , e t ) = (Sg k , g,) = d kJ s k (Kroncckcr delta). Consequently 

r.t r.i 

Vlt tj 2 , ... are independent with means 0 and variances s t , s 2 ... under p v Wo may 
thus conclude that L(x) = lim L n (x) for almost all x whore 

£.(*) — tJ. {(~ l ) **&*+ logs * }■ 

Since tr(5-/) 2 < co, £ (— -1 )* < co and hence £ log converges or diverges 
with £ ( - 1 — 1 )• Assume now that S—I is of trace class i.e. £ ^ — 1 < co. Then 

S — — 1 • [y fc (x)] 2 converges with probability one and hence wo have 

* 

Ux) =-± 2 ) [?*<*)]*—\ Slog 

Z k \ S k ' 
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If Y is the sot of all .r such that 7 fc (x) is finite for all k and S | ^ - 1 [V* l*)) 2 < '*• ,l 

is clear that Fisa linear manifold of probability one and L is. omitting an addit.ve 
constant, expressed as an absolutely convergent series of summands each of which is 
a constant multiple of the square of a linear function. In this sense it is possible 
to regard L as a quadratic function. Notice that the condition that (.9-7) is of trace 
class, which was imposed during the course of the above discussion is stronger than 
the condition tr(5—7)* < co which is necessary and sufficient for equivalence of p x 
and p t . 

This quadratic function is not in general the. quadratic form associated with 
any linear transformation of X. When X is finite-dimensional. L is. upto an additive 
constant, the quadratic form associated with the matrix Af'—Aj*. In tlie infinite 
dimensional case Af l and Aare unbounded operators and consequently Af'-Af 1 
need not be even defined for a large class of vectors. It is therefore not surprising that 
one is not always able to exhibit L as a quadratic form. Given a function / on A we 
shall say that /is a quadratic form if there exists a closed, densely defined, symmetric 
operator A (i.e., {Ax, y) — {x, Ay) for all x, ycD{A)ft * ,,ch t,mt <•> 7 >aWd)) - 1. 

(ii) f{x) ^ {Ax, a-)4-c for some constant c and almost all x. The question that wo 
want toexnmine now is this: when is L a quadratic form in the sense of this definition ? 

Wo proceed to prove a series of lemmas. />, and p 2 arc equivalent Gaussian 
measures with means 0 and dispersion operators and A,; c x . e 2 .... is an orthonormal 
basis for A' such that A 2 e n = A„*„ for all w, A. > 0 a constant. Since tr(A a ) < co, 
for any projection P in X, tr (AJ PAJ) < co. We shall denote it by n{P). It is easy 
to show that n{P) — tr (A 2 P). n is countably additive over mutually orthogonal 
projections. 

Lemma 1 : The following statements on a closed densely defined operator A 
are equivalent. 

(i) p 2 {D(A)) = 1. 

(ii) -4A$c n is defined for all n and £ ||dA|cJ|* < co. 

(iii) M = -4A| is defined everywhere, is a bounded operator and tr{M*M) < co. 
If A is in addition self-adjoint then these arc also equivalent to 

(iv) J t*da{t) < co 
—* 

where a is the measure on the real line defined by a{E) = n{P B ), P{E~* P B ) being the 
spectral measure of A. 

Proof: If J7 is a bounded operator then tr (J/*J7) < co if and only if 
E(Af*J7 e n , e n ) = E [| A7eJ| 2 < co and consequently (iii)—♦ (ii). Conversely lot us 
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assume that (ii) is valid. If x is a finite linear combination, say x 1 c 1 + ...+ar f e r of norm 
1, so that 2 1**1* = 1, then 3/ is defined for a- and || Mx || 2 < ( £, \x t \ || Me { ||) 2 < 

? 11M e * H 2 ‘ ? I ■ *i 1 2 < 0 where C = 2 ||3/e.||*. Therefore || 3/a: || < C || a:|| for all finite 

linear combinations a: of the c/s. Since A is closed, it follows easily from this that 
3/ = /1AJ is defined everywhere and ||3/r|| < C \\x\\ for all a:. Since 2 ||3feJ| 2 < co 

("i) fo,, °ws immediately. This proves that (ii)—> (iii). 

If -4 is closed and densely defined there exists a self-adjoint II such that 
D{H) = D(A) and ||//m|| = ||i4u|| for all ueD(A)\ in fact we may take H = (A*A)* 

(Riesz-Nagy, 1952). This means that for the equivalences (i) <-► (iii) <-► (iv) it 

may be assumed that A is self-adjoint. We shall do so. 


Suppose now (i) is true. Wo shall prove that (i) —► (iv). For any xeX let v, 
be the measure E —►||/ > **||* on the line, P being the spectral measure of A. Wo know 

that D(A)= {r: / < 2 dv.(<) < co). Write D s — {f:< |/| < j+1) j - 0, 1, 2, ... Then 
- 00 

xcD(A) if and only if 2 J t a dv,(t) < co. Since p 2 (D(A)) = 1 and / / 2 dv x (/) > j 2 v x (ZX) 

J D J Dj 

it follows that2 j 2 v a (Dj)<cx) for almost all x. Now lot (/* «* 1. 2. ...)bean orthonormal 

basis for tho range of Pdj and let v Jlt (x) = (Pdj x, h Jm ). Then 2 (t^(r)) 2 =- 2 j 2 v x (D.)< oo 

i 

with probablity one. Sinco the joint distributions of the are all Gaussian and 
sinco E Pi (v Jlt ) = Owo easily conclude that 2 E Pj vf m < oo i.e that 2 j 2 E Pl {<f> } ) < co 

whore E Pl denotes expectation with respect to p t and ^(z) = v x (/Jj). Since E Pi {<J> i ) 

00 

= tt^Pd)) = tr(PDi^ 2 ) = <*(&))• wo get Ej 2 ^/),) < co. This proves that / t 2 da(t) < co. 

i - 00 

00 

Conversely from tho finiteness of / t 2 da(t) we may conclude that 2 (j-f-1) 2 a(Dj) 

-m i 

= 2(j+l) 2 EpX^i) < co from which the convergence for almost all x of 2 J t 2 dv x (t) 
J i Dj 

oo 

bm J t 2 dv x {t) follows at once. This proves that (iv)—»(i) and completes the proof that 
— 00 

(i)<-> (iv). 


We now proceed to the equivalence (iv) <- > (iii). If ||r|| = 1, 

v . (E) = \\P E Alr\\ 2 =(AiP B Alx,x)^tr(AlP B Al)=7T(P B )=a(E). Thus, if J l 2 da(t) < co 

A 2X ~ 

then {*t 2 dv u (t)<cx> for y = A Jr, * being arbitrary and of norm 1. This proves that ^Aj 

— CO 

n n 

is defined everywhere. Moreover, for any n,a n (E) =^2 ' ^(E) = 2 (AJ P B Aj^.e,) 

< tr(A{P,Aj) = a(E) so that 2 |MA}e,|| 2 = t 2 da n {() < _f t 2 da(t) < co for all n. 
This proves (iii). Finally let us assume that (iii) is valid. Since a n {E) t a(E) for all 
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Borcl sets E and f W..KK ? I^.P < » for all a. it easily follows that 
- * 1 

fftl „«) < CO. This prove that (iii)s— <iv) and finishes the proof of the lemma. 

-00 

Lemma 2 : Lei A hr a closed, densely defined operator will. p^lfiA)) = I 
and lei M = AAj. Then A} M is a bounded self-adjoint operator of trace class. 

Proof: Since M is bounded so is AjJf and since Aj.lf is symmetric it is self- 
adjoint. Further for any xcX. |<A|.4Ajr. *)| = | (dA.U. Ajr)| < IIA|* II'll ^ A S' r » 
^(IIANl'+MAtrlP) < <»''•*> »hcre V = I(A, + 3/M/). Since this is true for 
all a; and since V is a nonnegative operator of finite trace wo may conclude that 
AjAAj is of trace class. 

Lomnu 3 : Let A be a closed, symmetric, densely defined operator with p^D(A)) 

« 1 . Suppose further that {(A +Af»)*. x) > 0 for all nonzero xcR(A t ). Then K = 
AJAAJ + / is a bounded self-adjoint operator for which K > k.l for sonic k > 0 so that 
K has a bounded inverse. Moreover. A + A:\defined on 7?(A 2 )) is a closed symmetric 
operator. 

Proof: By Lemma 2. A is a hounded self-adjoint operator. Since /1AJ is 
bounded. AM A J is compact and her.ee K has a pure point spectrum with its eigen-values 
converging to I. For any xefl(A # MM+Aj»)x. *)- (K Aj»*. Aj»x) > 0 so that A' > 0. 
Thus in order to prove that K > k.l for some k > 0 it iscnough to prove that 0 is not 
an eigon-value of K. Suppose for seme y & 0. Ky - A[(AA[)yAy *= 0. 'I hen 
Aj(i4 Aj y) ——V showing that ycR( A|) and AA[y — Aj*//. If r =» A}»/. then xcR(A t ) 
Aj»x = a* *// and Ax A- Aj*x = 0. Since x gfc 0 and ((A+A{ l )x, x) - 0. we have a 
contradiction. Finally wo claim that A -f A ;». defined on R(A t ). is a closed symmetric 
operator. Tho symmetry is obvious. Supj>oso x n cR(A t ) for all n and x„-»x. Ax n 
+A i'x n ->z. Write x„ Aj»y,. Then Aj(Ax n + A ;»xj = Ky m -*A^z and since A' 1 is 
bounded, y n -+ a limit, say y. Sine© AA\ is bounded. AA\y n = Ax m tends to a limit 
and honee Aj *x B tends to a limit. Since Aj 1 is closed. xeD( Aj 1 ) = R( A,). It is then 
obvious that |-Aj*x B -» Ax+ Aj'x. The lemma is proved. 

Lemma 4 : Let A be a closed, symmetric, densely defined operator with p t (D(A )) 
= 1 and let ((A-f A* l )x, x) > 0 for all nonzero xcR(A 2 ). Then there exists a unique 
nonsingular dispersion operator A\ such that A+ Aj* = AJ“ l . 

Proof: Since K > k.l wc see that (M + Aj*)x, x) ^ A*(Aj'x, x) for all xei?(A 2 ) 
and since Aj 1 ^ k'.I for k' > 0 we see that for any xe/?(A 2 ) with ||x|| = 1, ||M + Aj x ).r|| 
^ |(M4-Aj l )x, x)| kk' > 0. Since yl-fAjHs closed, it follows from this that the 
range of 4+A? 1 is a closed linear manifold in X. A', = (.4+ Aj 1 )- 1 is defined on this 
closed linear manifold, and is a bounded linear transformation thereon. We now claim 
that this range is the wholo of X. It is enough to prove that it is dense in X. Suppose 
now for sorao u, ((-4 -f- Aj l )x, u) = 0 for all xcR{ A t ). Then ((A + Aj x )A| y, u) =0 
for all t/eA(Aj)and hence (My, u) =—(Ajh/, u) for all ycA(Aj). Since M(= AAj) 
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is bounded, this shows that uei?(A|) and AI*u+A = 0 so that (A/*Aj+/)A£*tt = 0. 
Since A| M is bounded self-adjoint, J/*A|+/ = K so that KA^u = 0. Consequently 
A 2 * u = 0 and hence u = 0. This proves that i?(yl+A* *))=A: and hence AJ isabounded 
operator on X. As it is the inverse of 4+Af\ AJ is symmetric, > 0 and is nonsingular. 
Since K = Aj/lAJ-f / it follows by a straightforward computation that AJAT^AJ = Aj. 
Now K~ l is bounded and hence Aj = A| K~' Aj < cA 2 for some c > 0, showing that 
tr (^i) < - °°- T* 1 * 3 proves that Aj is a dispersion operator. The proof of the lemma 

is complete. 

Let Q n be tho projection on the subspacc spanned by q, ...,e B and let Q' n = 
^ Qn- * or ^ny linear operator F whoso domain includes all the vectors e y wo write 
F n for the n xn matrix ((/>*, «,)) Many properties of the linear operator 

can bo reduced to an analysis of the asymptotic behaviour of the matrices F n as w—>a>. 
For example, if F is a bounded self-adjoint operator such that F > a.I for some a > 0 
and F—I is of trace class then |F,| > 0 (where | | denotes determinant) for all n 

and converges to a finite nonzero limit as w—»oo. This limit is independent of tho basis 
used to compute it. Wo shall write it as |F| and call it tho determinant of F. It is 
oasy to show that | F~ l | also exists in the above sense and is equal to | F | “ l . 

With AJ as dofined in Lemma 4 form tho matrix C n = (AJ _1 ) n i.o. tho matrix 
whose i— ,7-th element is (AJ _l e<, e } ) For any ycX wo denote by y n the row vector 
((y, Ci), ... (y, c B )). 

Lemma 5 : With the above notation 

'J« C nWn — (AJy, y) 

n —► OO 

for all ytX. 

Proof: Fix yeX. We know that two Gaussian measures with mean 
difference AJ y and dispersion operator AJ are equivalent and the D ^ botweon these 
two measures is (AJy, y). On the other hand, if £j(x) = (x, AJ" 1 Cj), tho dispersion matrix 
of £„ ..., £„ is C„ while the row vector of mean differences is ((y, (y, e„)), so that 

tho D\ between the two distributions of £„ .... £„ is y n C~ l It now follows from 
Theorem 4.1 that y n C~ x (Aj y, y). This proves tho lemma. 

Lemma 6 : Let A be a closed densely defined symmetric operator with 
p 2 (D(A)) =1. Then, 

lim (Q n AQ m y, y) = (Ay, y) 

" —* oo 

for almost all y. 

Proof: Since p 2 (D(A)) = 1, it is clearly enough to prove the lemma with A 
replaced by any one of its extensions. Tho Hilbert space X being real there is at 
least one self-adjoint extension of Aj We may therefore assume that A itself is self- 
adjoint. Moreover any self-adjoint A can be written as A + —A~ where A + and A~ 


fcf. Stone (1932). p. 367. 
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arc > 0, self-adjoint and D(A+) D XX^). *A-) D D(A). It is thus enough to prove 
Lemma 6 when A self-adjoint and > 0. 

Let P be the spectral measure of A. For any t > 0 lot F,,. bo the set 
: jt < t < 0 + 1)6} and A, the operator S jt . Sincc J ^ ,j) p ^ y) ~ 

tv(AiP Pj Ai) it follows that Eja. J 0V** JfWrfar)'-tr(AM.A|> <oo and hence that 

the function y—*(A,y, y) is intcgrablo withJ(A,y. y)dp t (y) — tr(A|A f Aj). Now for"any 6, 
D(A,) = D(A) and |(Ay. y)-(A,y,y)| < *<y. 80 that Itr(A|A,A|)--tr(A4A A|)| < 

S |(Al(A-A,)AK. ej| <«A|e Il . AjeJ-ttr^A,) so that f (A,y, y)dp t (y) - 

tr(A^A|)+0(6). Since (A.y, y) ->(A y. y) as e-> 0 wc sec that J (A y, y)dp 2 (y) is finite 
by using Fatou’s lemma. Moreover | J (A y, y)dp 2 (y )— J (-4, y.y)dp t (y) | < t f(y, y)dp 2 (y) 
«. 0(t). Wo thus sec that the function y-» (Ay, y) is p 2 -intcgrablc and 

f (Ay. y)dp t (y) = tr (A|/1A}). 

Now let 7, (.r) = (x, e t ). The y x , Vt> ••• arc independent under p 2 . Let <?„ be the 
smallest or. algebra with respect to which ••• ar0 a,! mensurable. Then 

and by the zero-one law, consists only of sets which aro of measure 

0 or 1. Therefore, by the Martingale convergence theorem, if we have any integrate 
function g. and write g n - E* t (g |<?J, then y„(y)-* J for almost all y. Take for g 
the function y-> (Ay, y). For any n, g(y) * (A<?«y. <? n y) + 2(<? n y. A(/-<? B )y) + 

((I—Q n )y, (I—Q n )y). Hence, a straightforward computation yields 

g n (y) = tr (AkA.AU + (A(/-Q.)y, (I-QJy). 

Since ti(A|„A.A4 n ) — E (AJAAJcj, c,)-*tr(AlA A|)« jgdp t , it follows that (A (l—Q n )y, 

(l-Qn)y)-> 0 for almost all y. But (A(I — Q m )y, (I—Q n )y) = (Ay, y)+(Q n AQ n y, y) 
-2 (Ay, Q n y) = (Q„AQ n y. y)-(Ay, y)+£„(y) where c ,(y)-> 0 as «-»co for ally. 
We therefore conclude that (Q n AQ^j, y)-» (Ay, y) for almost all y. Lemma 6 
is thus proved. 

Lemma 7 : Let A be a closed, densely defined, symmetric operator with 

p t (D(A)) = 1 and let g(y) = exp[—--( Ay, y)j. Then in order that j gdp 2 < co it is 

necessary and sufficient that ((A+A£ 1 )*, x) > 0 for all non-zero xeR(A t ). In that case 
f9(y)dp 2 (y) = |^| _ * where K = A| AA|+/ and |A| denotes the determinant of K. 
Moreover, for any ueX, g(y)e i{Vm) is integrable and f g(y)e i{VtU) dp 2 (y) = | K | “* 

exp [~ (Aju.ti)]. 

Proof: Wo shall first examine the conditions for the integrability of g. 
Suppose that ((A+Aj 1 )*, *) > 0 for all non zero xeR( A 2 ). For any n let f n (y) 

MQ.AQJ/, y). By Lemma 6, exp[- exp[-+^y, y)] = 9('j) for almost 
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all y. Moreover / f n (y)dp z (y) can be easily checked to be equal to the integral 
J n where 

Jn = <2*)-»/*|A lll |-» J exp [-\z{A m +AH)*\dz 

and 2 = ( 2 lt z n ). The assumption on A+A£ l implies that the matrix A n + 
is positive definite and hence 

J. = = |A|.^.A|.+/ l ,|-l 

so that 

Since exp£ —^f n j > 0 and converges by Lemma 6 to g almost everywhere, and since 
J n tends to | K\ it follows from Fatou’s lemma that g is integrablo with its integral 

Conversely let us assume that y is integrablo. Let fyx) = (x, tA and Q n 
the smallest rr- algebra with respect to which 5„ +I , ... are all measurable. Let 

Hy) == £/(.'/) exp[%, u)) and define g n = E Pi (g \<?„). = E Pi (h |<? N ). The argument 

given in Lemma 6 may now bo used to provo that g m (y)-*E Pt (g) and h n (y)-> E Pi (h) 
for almost all y. Sinco g is integrablo and since (Ay, y) — (Az, z) + 2(z, Aw) + (Aw, w) 
whore 2 = Q n y, w = (I-QJy it follows that for almost all the function 

2 ->cxp [- l 2 -((Az,z)+2(Aw,z))] 

is integrablo with respect to the n-dimensional normal distribution having dispersion 
operator Q n A 2 Q n . The integrability for oven one w implios that the matrix C n 
= A n + A 2 n positive definite. A straightforward computation now yields 

».(y) = |A 2 .|-'|C.|-»ex P [- + 

whore y n = (I — Q n )y, z n is tho row vector whoso »-th component is (Q n Ay n , c t ). A 
similar computation on h yields 

h n (y)= |A 2n ||(7*1 ”*xexp [- l 2 (Ay H ,y n )+i(y n ,u)+±z n C;'* n 

- l 2 u n C-^ n -iu n C^ n ] 

where u n is the row vector with *-th component (Q n u, e 4 ). Comparing the formulae 
for g n and h n we got 

h n (y) = 9n(y)CX P [“ g U * C * IU *] eX P W<y*« 

Let us write J for J gdp 2 and J(u) for / hdp t . Since | h n (y) | -► | J(u) | as n-> co for almost 
all y, we may conclude that g n (y) exp [ - * u n C" 1 ***,] converges to | J(u) | for almost 
all y. Since g n (y)-> «/ for almost all y it follows that u n C; l u' n has a limit for each ueX. 
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There exists a unique bounded self-adjoint operator //„ on X such that 
(//„ u, u) - u n <?->«{. for all «. Since lim (H n u. u) exists for all t*X it follows from 

a well-known theorem that \\H n \\ < k for"all n,k> 0 being a linito constant. 'I bis 
shows that 0 < C n -‘ < k.I n for all n(/„ being the nxn unit matrix) and hence that 

C n >-£./„ for all n. We thus deduce that C n A|* > £ A tn for all n. If K 
denotes tho bounded operator A|AA|+/, this moans that K n >~A 2n for all n and 


hence K > { A 2 . Since A* is non-singular, this inequality implies that Kx = 0 only 

when x = 0. Since K has a pure point spectrum with non-negativo eigen-values 
which converge to I, this implies that K is invertible and hence K > k'.I for some k' > 0 
from which wo may conclude that ((/l+A^Jx, x) > 0 for all non-zero xcR(A 2 ). 
From Lemma 5 we know that (A^v, u). 


We shall now evaluate the limit of h m (y) for each fixed u. Sinco J 

and uJO^u^iA^u.u) it follows that exp (»(w. yJ-iti/V*,! has a limit for almost 
all y. Since (»«„, y)-> 0, it follows that exp (—iw.C-VJ has a limit for almost all y. 
If we write fi n (y) — — u m C;' **, then /?„ is real linear in »/ and exp(»/?„(»/)) has a limit 
for almost all y, tho limit being independent of y (*= J/\J(u)\ in fact). Such a limit 

must necessarily bo equal to 1 and hence h n (y)-*J exp * (A',m, h)J . Sinco K > k'.I 


and sinco K — I is of trace class,|X„| = |Aj„C n A| w | — | A tn | .|C n |-»| if | «<> that 
I A 2n 1 -»| C„ | -*-> | K | Since ( Ay n . y n ) = (Ay. y)+(Q*AQ n y, y)-2(y n . Ay) wo may 
oonclude from Lemma 0 that (Ay n . y n )-* 0 for almost all y. Wc thus finally see 
sinco z n C; x > 0, that J > |X|-» and henco that 0.(y)->| A'|"» and li„(y)-+ \ K \ 


0Xp ( — M >] • 


Lomma 7 follows at onco from this. 


Remark: It might bo of interest to illustrate Lemma 7 with some examples. 
Let X = L*( 0, 1) and A, tho integral operator with kernel k(s. /) — min (s . /). p 2 then 
is Wiener measure with variance parameter 1. Let A > 0 and A =— A./. 

A simple computation shows that tho eigen-values A p A 2 , of A 2 are all simple 

and A, = 4w-*(2»—1)“*. According to Lemma 7, the function x-> exp (-Jr- A(.r, x)] is 

intcgrablo if and only if —A(x, ar)+(A£* x, x) > 0 for all non-zero xeR(A t ). Wc claim 
that this is equivalent to the condition A < A; 1 for all n. If x = e„, then — A(x, x)-f 
(A 2 l x, x) > 0 for x = e n gives A < A„. On the other hand suppose A < A" 1 for all 
n. Then for any x = 2 x m e m e R( A 2 ), — A(x, x)+(Af l x, x) = E(— A-f A^ *)r* > 0 with 

equality attained only when x„ = 0 for all n. Lemma 7 then gives tho value of tho 
integral as 


49 


l-AA I+ /,-*=[ i n[ l -i^ i) ]]- = [5e0 A.)'. 
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being the condition for integrability. 


Lemma 7 thus yields the formula 


/ ox p[4*/ ] dp t (x) = (sec A*)*(A* < nl2) 

(c(. Gelfand and Yaglom (1960) and Silov (1963)). 

As another example let us consider the function 


/, 



ipMxHOdt} 


where A > 0 and p is a continuous non-negative function on (0, 1). Let m(A) 
= inf p(t) for any closed interval AC[0, 11 and let us write rr p = sup (| A | 2 m(A))( | A | 

denotes the length of A). Lemma 7 can then be used to prove that f p is integrable 
if and only if the condition 



is satisfied. When p(t) = l,<r p = 1 leading to the first example. When p(t) 
the condition becomes A < 4 t7*. 




Wo are now in a position to formulate and prove our second main theorem 
this section. 


of 


Theorem 6.2 : Let p l and p t be tivo equivalent Gaussian measures with means 
0 and (non-singular) dispersion operators A, and A 2 . Let L = log ( dp l /dp t ). In order 
that L be a quadratic form it is necessary and sufficient that i?(A,) = Il(A 2 ) and that 
(Af l — A 2 x )AJ has a bounded extension M to the whole of X with tr(M*M) < co. In 
this case the closure A of Af * —A 2 * exists, is a closed symmetric operator with p 2 (D(A)) 
= 1, and for almost all x 

Ux) - j(Az, *)-i log |S| 


where S is the operator satisfying the equation A, = Aj .S’Aj. 

Proof : Suppose first that the conditions on A, and A 2 , specified in the theorem, 
are satisfied. Af 1 —A 2 1 is then densely defined and since it is symmetric, its closure 
exists. Let A denote this closure. The finiteness of tr(J/*lf) implies that S || A A jc n || 2 

<oo, and hence by Lemma 1 ,p t (D(A)) = 1. Since -4+A** = Af 1 on R( A # ), the condi- 

tions of Lemma 7 are satisfied with A; = A,. Consequently exp *)] is an 

integrable function with 

J exp [-^Az, *)+«*. «)]«W*) = 1^1"* «P[-T 
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for all u. Now K = Aj^Aj+i and hence Ke m - 

= S- l e n for all n. This implies that K = 5" 1 and henco that = \S\ . VVo 

thus conoludo that 

| S | -* J exp [- ±(Ax, x)+Hx, u)l dp t (x) = exp [--j (A x u, u)j . 

This shows that d Pl ldp t is the function x-+ |5|-‘ ©xp[-~ (Ax, x)] and leads to 
l.ho result that 

log |S|. 


Conversely, lot us assume that L is a quadratio form. Then there exists 
a closed, symmetric, densely defined operator A with p t (D(A)) = 1 such that 

L(x)= — g (-4*. x)+c for almost all x.cboing a constant. This implies that the function 


X—► 


exp^_i(Ax, x)jis integrablo with respect to p t . From Lemma 1 wo infer that 
M = AA[ is everywhere definod and tr(J/*jl/) < co. Moreover R(A 3 ) Cl D(A) and hence 


^ + Aa l is defined on R(A t ). Lemma 7 implies that 4 +A'*" 1 = Af* where A[ is a non¬ 
singular dispersion operator. Evidently R(A\) s- R(A 3 ). Theorem 0.2 will be com¬ 
pletely proved if we show that A[ = A,. From Lemma 7, wo have, foi all u cX, 


/ exp (Ax, x)4-«(*, «)]<*/>*(-^) - |S|*exp [—L(A;u,u)J. 


Since L(x) — — 2 (Ax, x)+c and since 


f ©xp [- ~(Ax, x)] dp t (x) = | 5| *, 
wo concludo from the equation / oxp lAx)dp t (x) = 1 that 

--‘ log 1S | 

and henco that 

J exp [L(x)+«(x, u )] dp t (x) «= oxp [— l(A[u, *)]. 

Since L = log dpjdp 3 , the integral on the left is equal to oxp [— i(A x w, u)}. This proves 
that Aj = A[ and finishes the proof of Theorem 6.2. 

Corollary : In order that L be almost everywhere equal to c+q where c is a cons¬ 
tant and q the quadratic form associated with a bounded self-adjoint operator it is necessary 
and sufficient that R(A 3 ) = J?(A S ) and A x *—Aj 1 be a bounded operator on this linear 
manifold. If A denotes the bounded extension of A^-A* 1 to X , then A is a bounded 
self-adjoint operator and 
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Remarks: (1) It may be noticed that the conclusion that L is a quadratic 
form is symmetric between p x and p z while the conditions derived on A x and A 2 do not 
exhibit this symmetry. But this is only an apparent difficulty. Suppose in fact 
that R( A,) = R{A t ) and Af 1 —Af 1 has the closure A. We claim that N = (—A). 
A| is an everywhere defined bounded operator with tr(A r *iV) < co. Since A x = 
A|5A|, A| = A| 5*17 where U is an unitary operator and hence N = —-4A^5*C7 which 
is everywhere defined. Moreover N = — MSW so that N*N = U~ l ShM*MS^U. To 
prove that tr (*V**V) < co it suffices to prove that tr (5*A7*A75*) < co and for this it 
is enough to find an orthonormal basis.... of X such that £ || 5*37* J/5*/J| 2 <co. 

n 

Since tr(5 — 7) 2 < co, 5 has a pure point spectrum and hence we can choose an ortho- 
normal basis/|,/ 2 , ... for X such that 5/„ = s n f n for all n, s n > 0 a constant. Since 
£(*„-1) 2 < co, 1 as n-* oo. Consequently £ || 5* 3/*375*/ n ||* < || 5 || 

£ || 37*375*/J a < ||5|| £ 3 J 37* J7/J|* < oo sinco 1 and £ || 37*37/J|* = tr(37*37) < co. 

n n 


(2) It might be interesting to notice that oven the assumption that 5—7 
is of trace class need not imply the conditions of Theorem 6.2. We shall now describe 
an example where 5—7 is of trace class and yet 7?(A X ) docs not coincide with /?(A 2 ). 

Lot Aj, A 2 , ...>0 bo chosen so that £ A* < ^ Let e„ e 2 . ... be an orthonormal basis 

for X and let A 2 e„ = A n e n for all n. We define a bounded operator 5 by sotting 

f (l + 2At)e 1 +A|e 1 +... if j - 1 

Sti = < 

L A)e,-fe, if j > L 

If x = x x e x +...+x r e, is a vector of norm 1, then 

( Sx,x) = (.r? + ...+^)+2x 1 (a: 1 A| + ...+a: f A») = 1 + 2r l (a: 1 A^ + ...H r f A») 


and since |ar l (x 1 Al + ...+*rAJ) | < |x,| ^£ |aj|A* < (£ A^)* < 1/4 


wo see that ( Sx , x) > $ for all such x. This shows that 5 is a bounded self-adjoint 
operator with 5 ^ J.7. Moreover, 


(8—/)e i 


r 2Ate 1 +A|e 2 +... if j = 1 
L A) e, if j > 1 


from which we may conclude, that 5—7 is of trace class. If wo now write 



Ai(l + 2A|)Cj-t-Aj ^£^ A k e k 


ifj=l 
if j < 1 


then A __ y \J5Aj is a disporsion operator which is non-singular and the Gaussian 
measures with means 0 and dispersion operators A, and A 2 are equivalent. In this 
case R(A X ) * 7?(A 2 ). In fact e x <R(A x ). For, suppose a x , a 2 , ... are constants with 
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2 af < co such that A.C.«, + ...) = «, Using the definition of A, we get the equations 

A'A.a.+AjO, = 0 (t > !)• 

The above set of equations imply that o, = -*t«. for all t and hence that a 0 
for all t. This is a contradiction. In terms of matrices, A, is a lagona . ^ 

diagonal entries A„ A, ... while A, is the matrix (a,,) where a„ = A, (I + 2A|), «„ /, 

~ A| A ' ( ( 3) > AllThesc°consideration^ simplify considerably if A, and A, commute. 
In this case we can choose an orthonormal basis e„ e„ ... for X such that A,e - /.„e 
A 2 e„ = A„e„ for all a. A. > 0 and > 0 being constants. 'I ho cond.tion for oqm- 

valence is now E ( «•-. )‘ < «- *. - ( £ ) *» » - " ot lrftCC 


class if and only if £ — I < 


Since y 5 —* 1 it follows easily that R{ A,) — R(AJ 

A* 


and that the closure o"f A,-A, is the unique self-adjoint operator A for which Ae n 
= ( 1 - ~ )e. for all n. D(A) consisU of all zeX for which E ( ) <*• «•>'<«> 

and this has probability one if and only if E ( ^ -^ )’ A.< co which is also the condi¬ 
tion for L to he a quadratic form. This howover need notalways happen. If A„ “ >/»“ 
and = l/H*+nl then E |£-l | < oo but E (I )* A. - «. In other words 

even though *(A,) - *<A,)"when A,A, = A,A„ the conditions given in Theorem 2 
need not be fulfilled always. 

Wo shall finally take up tho discussion of the general case when p x and p 2 
are equivalent Gaussian measures with means m, and tn t and dispersion operators 
A x and A 2 . Let A - J(A X +A t ). Then m.-m, - ScR( A*) and A x - A| 5A| for some 
bounded self-adjoint 5 with S > *./ for a constant k > 0 and tr(S-/) a < oo. It 
is easy to prove that there are bounded solf-adjoint operators S x and .S 2 with 
S x > X- 1 ./,5 1 >M«ndtr(5 1 —/)*<coand tr(S 8 —/)* < cosatisfying A*"AJS X A} and A = 
AJS*A|. It follows from this that R(A\) = R( A|) — J?(A*)- If we now write q x and q 2 
for tho Gaussian measures with the same mean m = + and dispersion operators 

A, and A a . then it is an easy consequonce of tho above remarks and Theorem 5.1 that 
Pv Pi' 9i and 9i arc aU equivalent. Wo are now in a position to prove our final theorem. 
Theorem 6.3 : Let p x and p 2 be equivalent Gaussian tneasurcs with means 

w lt m 2 and dispersion operators A x and A*. I*t m = 


and 8 — m x —m z . 

Suppose that (a) R(A X ) = /?(A a ) (b) (Af •—Af *)AJ extends to a bounded operatorM defined 
over all of X with tr(8f*M) < oo (c) 8eR[A x ). Then the closure A of A x l — Af 1 exists, 
is a closed densely defined symmetric operator such that p 2 (D{A)-\-m) = 1. and 

Ux) =--i-G4(*-m), <*—m))+ i(*. Af 1 S+Ai> S) 


- i (m. A, 1 t+A;' t )- ± [t. At )—i log | S| 


/or almost all x. 
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Proof: Since p x , p *, q x and q 2 are all equivalent wo have 
L = log (dpjdqj+log (dqfdqj— log (dp 2 /dq 2 ) 
p x and q x are Gaussian measures with means m x and m and dispersion operator A v 
Moreover m x -m = tfeR( A,). Hence by Theorem 6.1 

log (dp./dq ,X*) = i (*, Af' A,-' A-‘i) 

for almost all x. Similarly, 

log ( d Pi ldq t )(x) — i (x, A 2 -« A 2 1 *)- I (<$, A*M) 

for almost all .r. Now since dqjdqjx) = dq'Jdq^x-m) where q\ and q % are Gaussian 
measures with means 0 and dispersion operators A, and A 2 , Theorem 6.2 enables 
us to conclude that the closure A of Af> — A, 1 exists, is a closed, symmetric densely 
defined operator with q' z (D(A)) = 1. Consequently q t {D(A) + m) = 1 and for almost all s 

,og ( dll ) ( * ) “~4 (i4( *“ ,w) ’ — m »—2 lo e 1 5 1- 

Combining all the three expressions wo obtain the required formula for L. 
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CLIMATES ANCIENT AND MODERN* 

By PAMELA LAMPLUGH ROBINSON 
University College, London 

I 

“I caii remember having neen a woman of Hi rah leave on a journey with nothing but a loaf 
of bread as provision, since right until her arrival in Syria, she paas-d nothing but flourishing 
villages, well cultivated fields covered with fruit trees, and a myriad of ponds and running 
waters. As you see. there is nothing but waterless desert today/* (A very old roan s words 
to the Muslim General KJ.alid, from At Matudi. A. D. 942. translated by K. W. 

Hutzer, 1958). 

The daily and seasonal vagaries of weather in any part of the world have 
always been of vital importance to human beings, even though nowadays the atomic 
bomb seems to be replacing an angry god as the scapegoat for bad weather conditions. 
But longer term changes of weather on a world scale, that is changes in climate, 
are less noticeable though moro important in their effects. They are not something 
that happened comfortably far off in the past, like the Ice Age, but are occurring now, 
for meteorological records have been kept for long enough to allow trends in world 
temperature and precipitation to be recognised. 

Since the late nineteenth century the world’s mean annual temperature 
has risen by 0.5°C, and mean annual winter temperature by 1*0. In the Arctic tho 
mean winter rise has been about 3®C. The effects of tho increase in temperature 
are seen in rising timberlines in mountainous areas, the shrinking of inland lakes, 
slight expansion of deserts at the expense of more fertile land, and the invasion 
of deciduous forest by steppe or prairie. More spectacular has been the effect on 
glaciers and floating ice. By 1932 the Swiss glaciers had shrunk by 25% of their 
area in 1877, and the shrinkage is continuing and could have serious effects on hydro¬ 
electric schemes run on glacier meltwater. In the first 40 years of this century the 
thickness of the floating ice of the Arctic region had been reduced by 40% and its 
area also diminished, and Arctic ports are open for longer periods of the year than 
in the nineteenth century. 

Historical records allow climatic changes to be followed further back in time 
though only in broad outline, and show that fluctuations of glaciers and lake levels 
have occurred in the Christian era, sometimes with serious consequences for human 


•Soo footnote on p. 401. 
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settlements. In Europe an advance of glaciers occurred in the sixteenth century, 
overrunning settlements occupied since an early period, and continued, though with 
fluctuations, until about 1850. This period is sometimes called the Little Ice Age, 
and its onset occurred in the fourteenth century, especially in higher latitudes. Earlier 
still milder conditions prevailed, for in the tenth century Icelanders sailed through 
ice-free seas to Greenland, and settled in the southern margins of that country, where 
they were able to keep sheep and cattle and raise crops. These settlements had 
perished by the fifteenth century, due to the return of glacial conditions to the margins 
of land round the Greenland ice cap (Brooks, 1949). During the waning period of 
the Icelandic settlement of Greenland, between the twelfth and thirteenth century 
A.D., the level of tho Caspian rose by 50 feet (Butzer, 1958). 

Naturally cortain regions are more sensitive than others to fluctuations in world 
climate, particularly areas of glaciers and pack-ice, and the marginal land between tho 
desert and the sown. But for the long term planning of human economy such changes 
require careful charting, and it is also necessary to see whether the fluctuations 
take place about some ascertainable norm, or whether they are part of larger trends 
over even longer periods. So these recent fluctuations have to bo regarded as the 
latest cpisodo in a history of world climate which extends through geological time. 
In this history tho last million years is tho best known and the most relevant when 
interest in world climato centros round its more practical aspect, its effects on human 
affairs, and the need to include a recognition of the extent and trend of climatic change 
in tho long range planning of human economy. 

Wo are living at tho present time in an Ico Ago, called the Quaternary 
period by geologists. Glacial conditions woro not uninterrupted, but occurred 
four times during this period, separated by intervals of milder climato in which 
tho temperatures in middle and high latitudes were somowhat greater than they 
are now. Tho time duration of the Quaternary is a matter of dispute; estimates vary 
between 300,000 and over a million years. Tho large discrepancy in those estimates 
is due to the lack of reliable means of dating events which occurred between about 
10 million years ago and about 35,000 years ago. Events older than about ton million 
years ago can be dated by methods using the radioactivo minerals containing uranium 
and thorium, which have a very long half-life so that errors in the measurement would 
bo too groat to allow them to be used for dates only a fow million yoars old. Radio¬ 
active carbon has a half-life of about 5,500 years and can be used to date events up to 
about 6-7 half-lives ago, that is about 35,000 years before the present (B.P.). Tho maxi¬ 
mum of tho last glaciation is the oldest Quaternary event which can bo reliably dated 
by radioactive carbon. 

An Ice Age is an unusual event in geological history. Before tho Quaternary 
extensive glaciations had occurred only twice, about 270 million years ago at tho end 
of the period called Carboniferous, and about 700 million years ago in late Prccambrian 
times. There have been equafly rare occurrences of very local glaciations, probably 
due to the development of mountain glaciers rather than extensive ico sheets. During 
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the climatic history of the world periods of glacial climate occupied not moro than 10% 
of the last 700 million years. 

The kind of world climate which has been most persistent in geological time 
is one in which warm conditions extended into high latitudes, and this climate has 
been coupled with a geography in which the continents protruded less above sea 
level than they do now, and had fewer areas of mountainous relief. 'I his warmer 
type of world climate is best documented for about 7.7 million years ago, at the 
beginning of the Tertiary period. At that time many of the plants which are common 
in the world today had already come into existence; moreover plant communities 
found in the fossil record are similar to those now living together. At present the 
distribution of plant communities is largely controlled by climate,each kind of climate 
having its own characteristic plant assemblage. Since the assemblages in the fossil 
record are similar to the modern ones it seems reasonable to use them, though with 
allowance for relief and other factors, as climatic indicators. A map has been compiled 
by Chaney (1910) showing the distribution of plant assemblages about 70 million 
years ago. Tt shows that subtropical and warm temperate climates extended- into 
much higher latitudes than now. including Great Britain and Middle Western North 
America, and that Alaska, Greenland and Spitzbcrgen enjoyed tem|K*rate climates. 



The evidence assembled by Chancy from fossil plants has been corroborated by similar 
studies made on the distribution of fossil marine bivalved and spiral shells about 
75 million years old, compiled by Durham (1959). At that time, although the Rocky 
Mountains and Andes existed, the great system of mountain chains extending from 
the Pyrenees and Alps to the Himalaya, Burma and China had not come into being, 
their sites were still occupied bv extensive shallow seas, and the world’s continents 
were rather more submerged than now. 

From the early Tertiary, 75 million years ago, climates seem gradually to 
have become cooler as time went on, and the later part of the period saw the erect ion 
of some of the large mountain chains which extend through Europe and Asia, and 
50 
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the rejuvenation of those in the Americas, and relief has increased in many of those 
areas even during the last two million years. The gradual climatic cooling and 
the increase in the world’s relief culminated in the Quaternary Ice Age, during which 
large ice sheets grew round mountains lying in the track of snow-bearing winds. 



Kig. 2. The tropical xono as indicated by marino faunas. Mop oompaiing present day 
distribution with that of 76 million years ago. (After Durham). 


The area covered by ice was greatest during the second and third of the 
Quaternary glaciations, but the siting of the main ice sheets was the same each time. 
At the maximum glaciations large continental ice sheets, and mountain glaciers, 
covered 30% of the land area of the world, as compared to 10% at present. The 
Greenland and Antarctic ice sheets were a little larger than now, but in addition there 
were major ice sheets in lower latitudes. In North America an ice sheet stretched 
from coast to coast at less than 50° latitude, and extended as far south as 40° latitude 
in the eastern half of the continent. In Europe the combined British and Scandi¬ 
navian ice sheet covered about six million kilometres, more than three times the 
area of the present day Greenland ice sheet, and extended as far south as about 50° 
of latitude, and there were large ice sheets in Siberia. The combined Himalayan 
and Central Asiatic glaciers covered more than a million square kilometres. 

The growth of these extensive ice sheets abstracted and locked up oceanic 
water on the lands, so that at each glaciation sea level fell, during the last glaciation 
probably bv about 100 m below present sea level, causing an increase in land connec¬ 
tions and the creation of new shore lines. During interglacials the reverse process 
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occurred, and as glacier meltwater poured back into the ocean, lowly.ng NP» wore 
submerged or broken up into islands, and a high shore line was created. The wc.ght 
of the ice sheets depressed the more rigid upper layer of the earths crust into th 
more yielding and viscous substratum, and when the ice disappeared the glacatcU 
area slowly rose again, vastly complicating the geographic history of the region, a 
warping adjacent strandlines of seas and lakes. The onset and wamng of each 
glaciation was not a steady process, but marked by oscillations of cbmat.c cond.t.ons, 
particularly of temperature. 


The growth and recession of glaciers occurred approximately simultaneously 
all over the world, and was accompanied by changes in lake levels in regions of ower 
latitude. In areas which are now part of the subtropical arid zone, and in latitudes 
close to the equator in Africa, lake levels rose at each glaciation, and thoro wore 
correlated changes in vegetation and the development of soils. 


Radiocarbon dating of the events of the last 35.000 years allows the changes 
in world climate to be traced in outline from the maximum of the last glaciation 
down to the present, and estimates to bo made of the dates of earlier events. Evidence 
of temperature and precipitation comes from a number of sources. On land the 
detailed history of migrations of plant assemblages and their soils gives the most 
reliable evidence, and the mapped extent of former ice sheets and lower snow line 
in mountainous areas; this can be combined, in lower latitudes, with the record of 
levels of lake strands and the type of soils associated with them. Evidence of ocean 
surface temperatures has been obtained by taking long cores of sediment from the 
bottom (Emiliani, 1961). The sites hnve to be carefully chosen far from the influence 
of land areas, so that very little sediment of terrestrial origin is being deposited, and 
there are no short term effects on surface temperatures by local currents and the 
shape of coasts. Cores taken from such sites largely consist of the minute shells 
of orgunisms which originally lived close to the ocean surface. The same species 
still inhabit modern oceans, and the distribution of particular species is largely con¬ 
trolled bv the temperature of the surface water. Counts made from successive 
layers record the predominance of colder or warmer water species, and indicate the 
surface temperatures at the time when the layers were deposited. A second line 
of evidence of surface temperature can be obtained from these layers of shells. The 
shells are built of calcium carbonate and when they were secreted the animal used 
proportions of the isotopes of oxygen which varied with the temperature of the sur¬ 
rounding water. The proportions of these isotopes in the shells of a single chosen 
species in a particular layer records the temperature of the water at the ocean surface 
at the time when the animal lived; and the amount of radioactive carbon remaining 
in the shells, when compared with that in the shells of living individuals, records 
the time which has elapsed since the animals died. 


The evidence from all sources suggests that at a glacial maximum mean air 
temperatures over continents in middle latitudes were about 6°C cooler than they 
arc now, and the surface waters of tropical oceans about 4°C cooler. At interglacials 
continental air temperatures in middle latitudes were 2°—3°C warmer than now, 
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and tropical oceans 1°—2°C warmer at the surface. During times of glacial climate 
the atmospheric temperature gradient was steepened and the belt of westerlies, with 
its cyclonic storms, shifted equatorward by about 15° of latitude. The shift brought 
increased rainfall, and a much decreased rate of evaporation due to cloudiness, to the 
present day subtropical arid belt. In Africa even latitudes close to the equator 
experienced an increase in rainfall, probably through the intrusion of cold air masses 
interacting with warm moist air from the Atlantic. During interglacials air tempe¬ 
ratures warmed and ice sheets melted, the belt of westerlies and cyclonic storms 
moved poleward, and subtropical deserts expanded. 


The last glaciation may have begun about 85,000 years ago, and in about 
15,000 years extensive ice sheets had grown on land, and equatorial ocean waters 
were cooling. The glacial episode continued, though with a fluctuation towards 
milder conditions midway, until about 17,500 years ago (see Table 1). Then the 
middle latitude ice sheets began to melt, and though temperatures oscillated back 
towards glacial conditions four times in the succeeding 10,000 years, by about 7,000 
years ago a period of warmth exceeding that of the present had begun, the Climatic 
Optimum (Atlantic Stage). This episode, lasting until about 5,000 years ago, at its 
climax brought mean annual temperatures about 2°C higher than now to the lands 
of middle latitudes. It is possible that the Arctic Ocean was free of ice during the 
warmest part of the Climatic Optimum (Brooks, 1949), but a cooler episode succeeded, 
culminating in the Sub-boreal Stage and lasting until about 2,500 years ago, and 
renewed the Arctic pack ice. From then onwards, through the Sub-atlantic Stage, 
climate has been very approximately similar to that of the present, with smaller 
scale fluctuations of temperature and rainfall. 


Tt is evident that world climate is influenced by trends of different magnitudes 
and which operate over very different time intervals. There arc the long term trends 
operating over tens of millions of years such as that which took place over the whole 
of the Tertiary period, probably cooling middle latitudes through about 12°C. Other 
trends operate over tens of thousands of years, and can be seen in the fluctuations 
of Quaternary climate through about 8°-9°C in middle latitudes, culminating in 
glacial and interglacial climates. Smaller fluctuations operating over tens of hundreds 
of years have produced the major oscillations in the advance and recession of glac.al 
conditions, and their order of magnitude may be about 4°C for middle latitudes. 
Finally there are the very small scale fluctuations seen in historic times, and m these 
temperature may fluctuate over a hundred or two hundred years or more, and rainfall 
may have rather shorter fluctuations, the difference in temperature being of the order 
of about 1°C mean annual, as the probable difference between the late part of 

Little Ice Age and now. 

The causes of these trends are not known, though there has been an attempt 
to correlate the small fluctuations over the last few hundred years with *»nspot cycles. 
T J maior Quaternary fluctuations are thought to be duo to changes m the total 
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TABLE I 


CM‘years B.p. 


1000 

2000 

3000 

4000 

5000 

0000 

7000 

8000 

0000 

10.000 

11.000 

12.000 

13.000 

14,000 

15.000 

16,000 

17.000 

18,000 

30,000-50,000 

50,000-70,000 


A.D.-B.C. 


Stag*' name 


Climatic n-gime and events 


10001 


A. D. 

B. C. 


10O0 

2000 

3000 

4000 

5000 

6000 

7000 

8000, 

9000 

10,000 


Sub-Atlantic Similar to pnwnt 


Sub-boreal 


Atlantic 


Boreal 


I-ate Dryas 
(Final Wurm) 


Altered 

Older Dryas 
Billing 

Oldest Dn-sn 

Main Warm 


Early Wttrro 


Cooler by about — 2 # CT 
than at present 


Climatic optimum on land 
Warmer by about + 2*C 
than at present. 

Arctic ocean free of ice T 


Slight readvnnce of glaciers 
Cooler by about - 6*C 
than at present 

Max. retreat of Great Lakes 
glaciers. Ocean surface tem¬ 
peratures rising. Warmer, but — 2*C 


below present 

Some renewal of glaciation 
Cooling 

Worming 


Cooler on land. 

Minimum glacial temperature in oceans 


Worming 

Great Lakes and othor glaciers begin 
to retreat 

Glacial maximum on land — 6°C 

Milder, somo deglaciation and warmin 
of oceans 


Extensive glaciation 
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of radiation are thought to be due to variations in the solar constant and in the reflect¬ 
ing properties of the earth's atmosphere. Changes in the kind of solar radiation 
received involve fluctuations in the ultraviolet band. Changes in the distribution 
of solar radiation over the earth’s surface are thought to be due to interaction of the 


periodicities of variation in the earth’s inclination on its axis and in its orbital motion 
round the sun. All these theories have been criticised on good grounds, and since 
changes in world climate should be regarded as involving trends of very different 
magnitude both in time and temperature it will be very difficult to sort out the complex 
of interacting factors which must be involved. 


The shortest oscillations of climate are of most immediate concern for eco¬ 
nomic planning. The arid and subarid regions comprise about 36% of the worlds 
lands. If, in addition to the present low level of living of about half the people 
of the world, populations continue to rise in numbers, then irrigation and cultivation 
of parts of the subarid areas will be a possibility to be envisaged now in long term 
planning schemes. This has already been recognised by UNESCO in its meetings 
and publications on arid zone research, and by individual countries such as Israel, 
USSR, and India. 


As yet there is no agreement on the method of defining an arid zone. This 
is not just an academic quibble affecting lines drawn on a map of world climate. It 
reflects a lack of knowledge about the way in which climatic factors, amount and 
intensity of rainfall, run-off, evaporation and temperature, interact with the physical 
characters of a region. There is also no agreement on the causes of aridity. When 
the arid zones were first recognised and charted it was taken for granted that they 
were reflections of the interaction of climatic and geographic factors. During this 


century there has grown an awareness of the way in which human activities can 
create semidesert areas. Now there is a tendency to regard such areas as mostly 
man-made, and this is also being applied by archaeologists to explain why certain 
areas, which formerly supported extensive and prosperous civilisations, such as that 
of the Indus Valley, should decline into aridity as these civilisations came to an end. 
It seems likely that there is now an over-valuation of the human contribution to 
the creation of the more arid areas of the world. The climatic oscillations which 
occurred between the end of the last glaciation and the present day have been 
sketched in by palaeobotanists and geologists without reference to particular theories 
about former civilisations (see Table 2). The swings from cooler to warmer episodes 
have brought the same effects to middle and low latitudes as occurred during glacial 
and interglacial phases, though on a diminished scale. As glaciers advanced a little 
in middle to high latitudes lake levels rose in subtropical and belts During the 
onset of the Little Ice Age the Caspian rose about 50 feet, and though .t su ^cquently 
fluctuated it maintained a higher general level dunng this cool phase d “ r "« 

the nineteenth and twentieth centuries. It is interesting, therefore, to see that the 
Indus Valley civilisation flourished at a time when the Climatic Optimum (Atlantic 
stage) had cooled down and the Sub-boreal phase was beginning with temperatures 
p_2 C cooler than in the earUer part of this century. This should have ameborated 
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Temperature 
difference 

-f from - 
present 1 



Climatic regime 


Atlantic 


• VVV 

B.C. 


- 200 


- 000 

3000 

- 1000 

- 


- 1600 

- 4000 

- 2000 


Sub-boreal 


Atlantic 


Warmer, rainfall 
decreasing 
«—rather milder 
♦-drier in Europe 

♦-drier in Europe 
rainier in 
Yucatan 


Rainer in Europo 

Drier in Europe 

★ 

Rainier in Europe 


Warming 


\\ arming 


Worming 


Caspian low 


.♦-Caspian high 
♦—slight fall in Caspian 
"I 4 —end of Oreenlund 
V settlements 
J Caspian rise* 50 feet, 

Settlement of Greenland 


W. Rujpulaun known to be 
already desert 


Rigvedo T 


Indus Valley civilisation 

Greater rainfall and dense 
population in present dry 
region of Baja California 


Final phase of lost glaciation 


rvcunvnoo horizon - renewal of upward growth of bogs in N. Europo duo to rise of water table, 
implying reourrenco of moistcr and coolor climate. Dated by Cd und 
archaeology. 
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the aridity of the Indus and Rajputana area, and the great numbers of bricks, baked 
presumably by wood fuel, found in cities and settlements inhabited between about 
3000 and 1800 B.C. along the Indus and former Saraswati rivers are witnesses to the 
well-wooded nature of the country at that time (Piggott, 1950). The seals found 
in these cities and settlements bear engraved pictures of animals which suggest a 
fauna more like that of Assam than anything found in the region during later historic 
times. At the same time as the early phase of the Indus Valley civilisation, about 
2.800 B.C'., a much rainier climate and a dense population occurred in areas of Baja 
California which are now arid (Hubbs, 1957). There is no doubt that human acti¬ 
vities can very much worsen the effective aridity of regions of low rainfall, and upset 
the delicate balance in areas on the borderline of aridity. But the overriding control 
of climate and geography have to be recognised, as suggested also by Wadia (1959) 
and even small oscillations of climate are therefore of great importance in the history 
and future development of an arid region. 


The charting of these oscillations of climate is still in its infancy, or not 
yet begun. In many semiarid areas meteorological stations have existed for a 
relatively short time, so that it is not yet possible to determine present day trends 
in temperature and rainfall. Even where records exist for 70 or 80 years, as they 
do at a number of stations in the Rajputana desert and its semiarid borderlands, 
there is no agreement on the results of the analysis of the data. Two Indian meteo¬ 
rologists have come to completely opposing conclusions on the same basic data, 
Banerji (1952) showing that there has been a tendency for rainfall to decrease since 
the late part of the nineteenth century and Pramanik (tl al 1953) demonstrating that 
there has been no change in precipitation. An Australian meteorologist, Kraus 
(19.Tr,, 1960), analysing the data for Jaipur near the border of the semiarid zone of 
the Rajputana desert, showed a decrease in rainfall during this century, a decrease 
shared by other stations on the margins of the arid belt which stretches from the 
Atlantic to India. Research on the statistical methods used to evaluate the metcoro- 
logical data seems urgently needed before a proper assessment can bo made of modern 
precipitation trends. In some parts of India separate analysis of ramfall duo to 
the S.W. monsoon and the N.E. monsoon seems likely to prove rewarding, as indicated 


by Kraus’s work. 

There are very few arid regions for which historical documents can supply 
evidence of climate, to continue back the record of observations from the penod of 
modern meteorological stations. Historical records are usually ^nty and tend 
to record extreme seasonal fluctuations of flood or drought for an 
rather than more gradual and persistent ameliorat.on or deter.orat.on of clrmate_ 
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of wind weather and running water in wearing down the land in Home places, and 
building up dunes, gravel, alluvium and similar deposits in other places, combine to 
form the physical landscape of a region. These arc long term processes which have 
been modified by changes in climate during their previous history. Some stimu¬ 
lating questions about these processes and their effects in Rajputana have been 
posed bv Raychaudhuri and Sen (19-32); some work along these lines is being done 
by the University of Arizona, and on soils by the Indian Institute of Agriculture. 
The study of soils is really a special aspect of this kind of research, climate and 
source rock interacting to produce various soil types. Old soils may have been 
buried beneath younger deposits and record changes in the action of climate on 
the source rocks of a given area. Soils and alluvium may contain identifiable 
fragments of plants or their pollen, and from successive layers it may be possible to 
work out changes in flora which are indicative of changes in climate. Inland lakes 
form natural gauges of rainfall and rate of evaporation through study of previous 
levels, and of the plants and fresh or brackish water shells associated with those 
levels. The shells may also be amenable to oxygen isotope determination of 
contemporary temperature. 

To compile all these records into a history methods of dating are necessary, 
and radioactive carbon dates may be combined with archaeological evidence at certain 
horizons, and under special circumstances it may be possible to use tree rings for 
dating (Zeuner, 1958). Many trees have a growing season which is determined by 
seasonal rainfall or temperature, and this is expressed in annual growth-rings in the 
wood. No two growing seasons are exactly alike, and the effects of dissimilar successive 
seasons is recorded in the relative thicknesses of the series of annual rings in a 
particular area. The pattern of relative thicknesses of rings of trees with a long 
life, and still growing, forms the standard for that area, against which can be matched 
the pattern of rings in logs of wood found at fairly recent horizons in alluvial lavers. 

I he subfossil logs can therefore be fitted into a time sequence provided bv the annual 
rings of trees still growing in the area, they can be used to extend this sequence, 
and the time when they ceased to grow and were buried can be estimated. Onlv 

m except, onaI circumstances can this method be used to estimate dates more than 
2000 years ago. 


of charljT 77 7 , • ‘ f 81 ’ P ' ied 10 8 Semiand or » rid with the object 

charting fluctuations of climate over the last few thousand years, would need more 

careful coorduiafon of effort and results than the customary academic projects. 

being a form of apphed research linked ultimately with economic planning • The 

rcsidts arc essential for planning the development of semiarid regions because they 

pronde information about the degree of aridity to be expected in an area over severe, 
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generations. If the degree to which conditions can deteriorate in a semiarid area, due 
to small fluctuations of climate, are not considered in planning the development of 
a region then some old resident may, towards the end of his life, reminisce in similar 
words to those quoted at the beginning of this essay. To use Rajputana as an example, 
it is not enough to plan so that a woman of Hissar may walk to Bikaner through 
well-watered country; it is necessary to ensure that her grand daughter may also do so. 


II 


•*I have boon laughed at by country people riding their mules by market while I chipped 
striated stones from tillite well within the tropics not far from plantations of coffeo and 
bananas in Brasil." A. P. Coleman. 1939. (Tillite is a bouldery deposit loft by ancient 
ico sheets). 


Other aspects of research on ancient climates have no immediate practical 
value for human economy, but arc of great importance to theory in biology and geology. 
Climatic change is an important factor in the evolution and migration of animals 
and plants. Peninsular India has a long series of rocks providing a potential record 
of land conditions covering about 230 million years, from 270 to 40 million years ago. 
Few other countries have such a long sequence of terrestrially formed deposits, and 
the Indian scries has much to contribute to our knowledge of the history of the evolu¬ 
tion of animals and plants and of climatic change. Birbal Salmi and his successors 
at the Salmi Institute at Lucknow, and earlier workers, have done pioneer work on 
a long sequence of floras obtained from these rocks. In the last few years discoveries 
and researches have been made on the vertebrate faunas of the Peninsula by the 
Geological Studies Unit of the Indian Statistical Institute (Jain, 1959; Jain, Robinson 
and Roy Chaudhury, 1902. 1964; Robinson. 1958) and the Geological Survey of India 
(Huene and Sahni, 1958), following the few pioneer discoveries made in the nineteenth 
century. The Geological Studies Unit of the Indian Statistical Institute is also 
investigating evidence of climatic changes to be found in the series of terrestrial rocks 
of the Peninsula, and some of this work relates to a very controversial theory of geology 
and geophysics, the theory of continental drift. 


This theory, as put forward by Wegener (1924) and elaborated by du Toit 
( 1957 ) and King (1962). suggests that about 300 million years ago the world's southern 
hemisphere continents, and Peninsular India, were joined together in a single large 
landmass, situated near to the South Pole, which has been called Gondwanaland 
after an old kingdom in the northeastern Deccan. In the northern hemisphere North 
America was jofned to Eurasia to form a second large landmass. About 150 nullum 
years ago Gondwanaland began to break up into individual continents, and the frag¬ 
ments drifted apart, South America westwards and northwards. A-traha a„d New 
Zealand eastwards, and Africa and Peninsular India northwards. In Middle Tertiary 
times about 50 million years ago. Africa and India reached and pressed against 
r u •« oancinv the folding and fracturing of marine sediments which 
the shores o margins of Eurasia and the northern margins 

“ '£££% ———- r tho grcat systera of moun ‘ 

tain chains from the Pyrenees to the Himalaya and Burma. 
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The suggestion that all the southern hemisphere continents and Peninsular 
India were once joined together has been made on various grounds, but one of ho 
strongest arguments lies in the curious distribution of cv.dencc for a glacml pen 
which occurred about 270 million years ago. in late Carboniferous tunes. The e% i enu. 
is found in India. Brazil. South Africa and probably also Rhodesia and Madagascar, 
and southern and western Australia. If the present position and relationships of the 
world’s continents are assumed to he permanent, it is very difficult to explain the 
occurrence of a glacial climate in India, but not elsewhere in the northern hemisphere, 
and in latitudes so close to the equator. If continents have drifted then it is possible 
to align India with the other three continents which were glaciated in late Carbonifer¬ 
ous times, in latitudes much closer to the south pole (sec Fig. 3). Recently pnlnco- 
magnetic evidence has tended to support the theory of continental drift, but that 
aspect will not be considered in this essay. 



C — cold ; W - warm tomporato ; arrow* show movement of ico shoots, with modem directions 
for Antarctica. 

Fig. 3. Tho loto Carboniferous glaciation. 270 million years ago, with tho explanation of its dis¬ 
tribution offered by tho theory of continental drift. (From King in Nairn. 1961.) 

Since India has a key position in this argument in favour of continental drift 
it is not surprising that those who do not agree with tho theory should doubt the 
nature of the evidence for a late Carboniferous glaciation in India. These doubts 
were expressed publicly in London a few years ago (Smith. 1961), and seemed justi¬ 
fiable because of recent work on some sedimentary deposits previously assumed due 
to glaciation, but which were found to have originated in a wholly different way. 
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U lien a great ice sheet, covering a large area, ceases to grow and move, 
stagnates and finally melts, it leaves a very characteristic deposit. While in move¬ 
ment the slowly flowing ice sheet accumulated a load of debris, partly caught up 
from the rock bed over which it passed, and partly acquired on the margins of its 
surface from projecting mountain peaks subjected to frost shattering. At the end 
of its history the ice sheet gradually melted and dumped the load of rock debris 
which it had been carrying, leaving fragments of rock of every size, from large boulders 
to the most finely ground rock flour, lying cheek by jowl. This is in marked contrast 
to accumulations of sediment deposited bv wind, running water or sea currents, for 
these have been sorted into various size fractions while in transit, and deposited as 
pebble beds, sands or fine silts. The great majority of all sedimentary deposits are 
of this relatively well sorted kind, and the exceptional nature of ice sheet deposits 
made them easily recognisable. Ice sheet deposits are known as till or boulder clay 
when of Quaternary age; more ancient and well indurated examples are called tillites. 
Tillites have other characteristic features. Their pebbles and boulders arc often 
striated with fine grooves, for while caught up in the moving ice sheet they wore 
scored by harder neighbouring fragments or against the bedrock below. Many of 
the minerals which make up the boulders or finer constituents of the till are of kinds 
which are easily broken down into secondary minerals or clays when subjected to 
weathering in a warmer humid climate Their presence in the till in a remarkably 
fresh state is due to preservation by refrigeration and subsequent rapid burial, and 
is another feature characterising the deposits of ice sheets. 

It seems that there should be no difficulty in recognising tills or tillites, but 
recently it has been shown that there is another kind of sedimentary deposit which 
has many features in common with tills. These deposits are now known as tilloids, 
and are formed by the sliding of very extensive masses of offshore deposits of the 
sea floor, due to a sudden change in slope caused by earth-movements; or by large 
landslides. The result is a very poorly sorted debris, and some scoring of pebbles 
and boulders can occur in transit. Tilloids have only recently been recognised, and 
the origin by gravity sliding of some examples of these rocks is still doubted by some 
geologists. 

The late Carboniferous deposits of South America. South Africa. Australia 
and India have some of the characters of tilloids. but in the three southern hemisphere 
continents there is a second line of evidence bearing on the nature of their origin. 
In several places in each of the three continents the deposit can he seen to lie on 
a floor of much more ancient rocks. The floor has a smoothed surface, like a pave¬ 
ment, and incised in the surface are a series of ruler-straight parallel grooves. The 
pavement was smoothed by the passage of ice flowing over it, and the striat.ons 
were cut bv rock fragments stuck in the sole of the ice sheet. Glaciers am producing 
exactly similar pavements at the present day, which can be seen when the ice recedes, 
during a series of relatively warm years. 

In India such pavements had been searched for, but only at one place had an 
example been found. It was discovered in the late nineteenth century (Fedden, 1874), 
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on the bank of a tributary of the river Wnrdlia near Chanda, was very briefly 
reported, and does not seem to have been visited since except by Coleman (1939). 

The doubts cast on the nature of the Indian evidence of glaciation were shared 
by Dr. Alec Smith, of University College, who had previously worked on tilloids and 
was amongst the first to recognise their significance. While working in India in 
collaboration with the Geological Studies Unit of the Indian Statistical Institute he 
decided to visit the site of the reported glaciated pavement, and also to bring mod* rn 
techniques to bear on the study of the deposit lying above it. On Christmas Day 
I960, after a suitable baptism while wading through the river Ward ha to get to the 
site. Dr. Smith was converted ns soon as he saw the evidence. The area exposed 
is not large, only a few hundred square yards in extent, and is covered each year 
by monsoon floods, yet it is a finely preserved striated pavement as easily recognisable 
ns any now emerging from beneath a modern glacier. 

The right bank of the Pcmganga river, tributary of the Wnrdlia. is made 
of hard limestones of Preeambrian age. perhaps formed non million years ago. The 
layers of limestone were buckled into folds, fractured, and raised up to form part of 
the ancient Peninsular landmass. After a long history of weathering under terrestriul 
conditions the limestones formed the bedrock over which the late Carboniferous 
glacier moved, and were smoothed and striated during its passage 27« million years 
ago. When the glacier melted its load of debris was dumped down over the pavement 
as the basal beds of the Talchir rock formation, burying and preserving the pavement. 
Modern weathering is now slowly removing the cover of Talchir tillitc. exhuming the 
glaciated pavement. 


Measurements were made of the directions of the striae, a ml these were found 
to run mainly from S. W. to N. E.. though a minority ran either more in a S. to N. 
or in a W. to E. direction. The problem of deciding which of the two possible 
directions. S.W. or N.E., represents that in which the ice sheet moved was very neatly 
solved by Smith (1901; 1903a). The Preeambrian limestones lie in a gently tilted 
stack of layers, the direction of the tilt being towards W.S.W. .Most of the edges of 
the layers were bevelled off smooth by the glaciers passage, hut at intervals the 
feather edge of a bevelled layer is plucked away to form a slight step, so that the 
whole pavement looks like a broad flight of very shallow stairs. The steps were 
formed during the passage of the glacier, for the treads are striated and continue ns 
the general expanse of the pavement, and tillitc lies tucked into the angle of the very 
short riser and long tread of each shallow step. Had the ice sheet flowed S.W. in 
the direction of tilt of the stack of limestone layers it would have rucked up and 
contorted their edges. Only by flowing in the opposite direction, N.E., could it have 
so smoothly bevelled the edges of the gently tilted stack of layers, here and there 
merely plucking away the edge of a bevel to create the shallow step. The risers of 
the stairs, facing N.E., show the direction of movement of the ice. and this is confirmed 
by many carefully observed details of the nature of the striae. 


.™ thin * st * ne ' s throw of the trees of the nearby village of Irai 

? h r B COImtry " e °'" C - »e chipped striated stoues from 

the Talchir tdlite, but these villagers had come tc quarry away slabs of the small 
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exposure of glaciated pavement to build the foundations for a house. When it was 
explained to them that the pale gentleman had crossed seven seas and thirteen rivers 
to study and meditate on the stones of the pavement the villagers, with the courteous 
tolerance which Indians usually show towards another man’s religion, readily agreed 
to get their stone from another outcrop nearby. With their cooperation the pave¬ 
ment is preserved, so that today dust devils, bom of the great heat of the tropical 
sun. whirl down the flight of stairs plucked out by the ancient ice sheet, and at 
midday the striated pavement, evidence of extreme frigidity, is often too hot to touch. 


In the Raniganj Coalfield, over 600 miles away. Smith (1963b) has recently 
found a second example of a glaciated pavement below the Talchir tillite, and its 
striations show a northward movement of the ice. This new discovery, and the 
wide distribution of the Talchir tillite through about 17° of latitude, indicates that 
the glaciation was not a local phenomenon, but the product of an Ice Age, as in the 
southern hemisphere continents. The peculiar distribution of all the evidence of 
glacial conditions during late Carboniferous times 270 million years ago remains a 
problem, to which the theory of continental drift has suggested a possible explanation. 


For the confirmation or rejection of the theory on climatic data it is necessary 
to find evidence of the distribution of climate in the Gondwanaland continents during 
earlier or later periods. The first difficulty that arises is the lack of means of recognis¬ 
ing terrestrial climates in sedimentary deposits, except for cold arid (glacial) or hot 
arid (desert) conditions. Desert climates leave traces in the record provided by 
sedimentary rocks, and fossil sand dunes are one of the most important indications 
(Opdvkc, 1961). The laminations which occur in fossil sand dunes were formed 
on their lee slopes by increments of sand brought by the prevailing winds. The 
direction of slope of the laminations, if measured for a fairly large number of fossil 
dunes at any one place, indicates the general direction of the winds prevailing there 
at that time. These palaeowind directions can be compared with the present surface 
pattern of world air circulation and its effects as reflected in modern sand dunes 
making allowance for slight alteration of the pattern which might be expected if 
the present ice sheets did not exist. Measurements of palaeowind directions have 
been made in Britain and show that 250 million years ago. in Permian times, prevailing 
winds were easterly, a faet difficult to explain if Britain were situated the same 
latitudes as at present. Although fossil sand dune laminations have been measured 
in N America, none have been recognised and measured in Ind.a. Africa o. Australia 
for the periods crucial to the theory of continental drift, that is between a out 0 
, .... nm i earlier and only one set of measurements ha\e been 

“made in m R America. Before any conclusions relating to the problem of continental 
drift can be drawn from palaeowind directions it will be necessary to.have am 
Ser number of sets of measurements available for the relevant periods of time. 

i rrnd rnrelv during the last 700 million years, but 

Glacial climates have occurred common. But to make maps of 

semiarid and desert eon. . . ■ ^ ony pcriod an indication of the more humid 
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on a possible indicator of tropical climate with alternate wet and dry season^ The 
work is being carried out in the Pranhita-Godavari Valley of the southern Deccan, 
India, in collaboration with the Geological Studies Unit at the Indian Statistical 
Institute. The work grew out of observations made on a very puzzling rock w nc> 
occurs not uncommonly in deposits about 190 million years old, of Upper Tr.ass.c 
age, termed the Maleri formation. The way in which the rock was deposited presents 
no problem; it occurs as stream and river-laid sediments, often filling in old stream 
channels in the red clays which are the predominant typo of Malori rock. But the 
problematic rock is mainly composed of rounded pellets of lime roughly sorted by 
stream action into various grades of size, usually from about a centimetre down to 
a couple of millimetres in diameter. The pellets have an interstitial matrix of clay, 
and arc sometimes cemented together with lime to form a tolerably hard rock. 

The origin of the pellets was a problem. They do not in the least resemble 
the calcareous nodules familiar to geologists, and which often preserve the laminations 
or bedding planes of the rocks from which they originated, and of which they form 
very well cemented samples. They resemble more nearly certain small pellct-likc 
structures made of lime and known as pisolites, which usually occur as marine rocks. 
Pisolites arc formed in warm and very shallow seas where the rate of evaporation 
is high and lime muds are being precipitated. Much of the lime is deposited in fairly 
homogenous horizontal layers, but where the water is agitated by wave action pre¬ 
cipitation occurs round small nuclei, sand grains or fragments of shell, and accretion 
round quantities of these nuclei produces a large number of pisolites. Presumably 
a similar deposit could form under terrestrial conditions in the waters of a largo 
shallow lake in which lime muds were being precipitated in layers in quiet waters, 
while pisolites formed in the more agitated water round the margins. However 
there arc no signs of lenticular layers of limestone in the Maleri rocks, to represent 
contemporary lake bottom deposits of this kind, and associated with pisolites at 
their margins. Nor could the pisolites be a contribution brought by streams from 
hilly regions surrounding the dcpositional lowland basin in which the Maleri deposits 
accumulated, for the conditions for the formation of pisolites cannot be expected 
to occur in hilly upland areas. The nagging problem of the origin of the Maleri lime 
pellet rocks remained, until observations of the banks of modern streams cut into 
Maleri sandstones and clays demonstrated that lime pellets similar to those of Maleri 
age were in process of formation at the present day. 

The Pranhita-Godavari Valley is ono of the hottest parts of India outsido 
the Rajputana desert and its environs. In winter (January) the mean daily tempe¬ 
ratures are 70°—75°F, and in May 95°F (with a mean maximum of 105°F), and 
this, of course, implies much higher daily afternoon temperatures. Even the monsoon 
rains do not cool the temperatures down very much, for July daily means are 80°—85°F. 
Only about 1% or less of the annual rainfall occurs outside the monsoon season, and 
then about 40—05 inches of rain may fall from June to October. In the monsoon 
season every stream and river fills and the water table rises close to the surface of 
the ground. During the dry months the top few feet of the soil, subsoil and 
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underlying rock gradually dry out as the water table sinks and stagnates, and all the 
smaller rivers and streams run dry. The alternate complete soaking and drying 
out ol the upper few feet of the ground and its subjection to year-round high tempe¬ 
rature. make it a zone of very active chemical weathering of a special kind. There 
is a great deal of lime disseminated through some layers of the Maleri clays and sand¬ 
stones. During the monsoon season this seems to be mobilised by solution, and 
some is carried away by the streams; but some rocks seem to act like sponges, and 
most of the lime remains in them, segregating into small pellets or irregular strings 
and sheets as the dry season begins. As drought continues these harden up, and 
appear to be able to persist through the next soaking of the rock due to monsoon 
rain, and perhaps also to grow by accretion of further mobilised lime. The result 
is a rotting sandstone or clay studded with small pellets or irregular sheets of lime, 
and which is readily eroded by the streams. Erosion sends some of the rotted rock 
down the stream bed. and the transporting water begins to sort it into various size 
fractions. This effects a concentration of the lime pellets, and occasionally stream- 
laid beds of them can be found in the modern alluvium of the area. It is probable 
that the Maleri lime pellet rocks originated and accumulated in a very similar way, 
though with many differences of detail. This implies that in the region surrounding 
the basin of deposition in Maleri times, and which contributed the lime pellets, condi¬ 
tions of climate and relief were not dissimilar to those of the Pranhita-Godavari Valley 
at the present day. The other types of Maleri deposit, and the fauna found in them, 
do not contradict the inference drawn from the lime pellet member of the whole rock 
formation. 

Work on this project has only just begun, and many details of the way in 
which the lime pellets form still have to be investigated, also the fact that the pellets 
do not form in certain kinds of lime-bearing rocks. General relief may bo a limiting 
factor to the formation of the pellets, even when a suitable climatic regime occurs. 
Very lowlying ground almost at sea level will have a water table so close to the surface 
over the whole year that the zone of alternate wetting and drying may be virtually 
absent. In very hilly terrain runoff and drying out after each rainfall may bo too 
rapid for proper soaking of the ground to occur and mobilise the lime in suitable 
country rock. The limiting conditions of climate under which the process can occur 
have also to be investigated, by work in areas with slightly different regimes of rainfall 
and temperature. Where the dry season is so short that the subsoil and underlying 
rock is always wet, lime is completely leached away. In arid climates there would 
be insufficient soaking of the ground for any considerable mobilisation and segregation 
of the lime at numerous centres in the rock, the water table being almost permanently 
well below the surface, and it is known that in such climates lime mobilises and segre¬ 
gates in quite a different way. It is drawn up from the water table to the surface by 
capillarity of the interstices between sand grains of the desert floor and dries out into 
a hard crust at the surface. Provisionally it may be said that, given suitable source 
rocks and relief, the lime pellets probably form in tropical climates with alternate 
wet and dry seasons, and with a sufficiently high rainfall to keep the subsoil 
and its underlying rock well wetted during the rainy period. Vegetation now 
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characteristic of these regions is light deciduous tropical forest and scrul. and t horn 
tropical forest. It is not known whether the wooded savannah regions should also 
be included. 

When the limiting factors for the formation of these lime pellets have been 
properly defined through study of processes operating today, they may form a useful 
indicator for past climates wherever they are found in terrestrial sediments, providing 
that they are studied as part of the general facies of the rock formation in which 
they occur. For any period in which the new indicator occurs it may he used, 
together with the well-known indicators of arid regimes, to map the distribution of 
terrestrial tropical and subtropical climates. It is hoped that in this way the new 
climatic indicator will prove a useful tool in assessing the validity of the theory of 
continental drift. 
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PUNCHED CARD PROCESSING OF SAMPLE SURVEY DATA 
FOR FRACTILE GRAPHICAL ANALYSIS 


By J. ROY and G. KALYANA8UNDARAM 
Indian Statistical Institute 

I. Introduction 

Frnctilo Graphical Analysis, devolopod by Professor Mahalanobis (1958, 1900, 
1961) has proved to be of considerable use in socio-economic studios. Tho purpose 
of this paper is to present a nuinbor of punched card data processing techniques for 
tabulation of survoy data for fraetile graphical analysis. 

Consider tho joint distribution of two statistical variables X and Y, of which 
Y is the variable of immediate interest and tho variable X is to bo used only for 
classification of the individuals. Lot m bo a fixed positive integer: then m fraetile 

groups in respect of the variablo X are formed as follows. The fractilo points . x„ 

aro defined by 

• r o - -co. F(xj) -±<f = 1 , 2.m-1), = +oo 


where F(*) is the cumulative distribution function of the variable X. Tho sub- 
population defined by < X < x t is called the i-th fractilo group (in respect of tho 
variable X). Let /i, be the mean of Y for the «-th fractilo group : 

/*<- < X < *,). 

Lot P s denote tho point with coordinates «. //<> •' = 1. 2. m. Tho graph joining 

consecutive pairs of tho points P„ P, . P m by 8traight , incs is ca||ed tho fraotUe 

graj)h (,?). 

When information is obtained from two interpenetrating half-samples of 
identical design, one can draw three fraetile graphs, two (f, and F.) separately from 
he two half-samples and one W from the pooled sample obtained by combining the 
two half-samples. The 'error area' bounded by F, and F t provides a sort of eonfi- 
donce region for &■, in any ease, visual examination of the three fractilo graphs F, 

' °^ n br , ,ngS 0ut ma "y Crating possibilities for further examination. 

When several fractilo graphs aro to bo compart, the error areas associated with each 
serve as a visual guide for assessing significance of differences apart from fluctuations 
of sampling. 

fea„.re, Pr °T C r!r S , * ’"T* ^ ^ P^°nts -me novel 

features. The determination of fraetile points and formation of fraetile groups must 
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be done independently thrice, once for each of the half-samples, and then again for 
the two half-samples combined. Each individual will thus belong to two fractilo 
groups : one for the half-sample and one for the combined sample. The complexity 
increases when the population is split up into a number of exclusive sub-populations 
in respect of some other criterion and three fractilo graphs are required for each such 
sub-population in addition to the three graphs for the whole population. Such is 
the case for instance whon fractilo graphs for the different geographical regions of a 
country are to be compared. Each individual has then to bo classified independently 
four times. Also, the total for the whole population for a particular fractilo group 
cannot be obtained by adding the totals for the corresponding fractilo groups for the 
constituent sub-populations, but must bo obtained directly. 

Wo shall describe in the following sections of this paper a number of proces¬ 
sing methods, using punched cards, which got round all the above difficulties and ensure 
considerable economy of machine usage. To make tho description concrete, wo shall 
discuss, in particular, tho problem of tabulating, on tho basis of consumer expenditure 
data collected by tho Indian National Sample Survey (NSS), tho average expenditure 
per person per month on particular items of consumption for fractilo groups formed 
in respect of the classificatory variable : household overall expenditure per person 
per month. 


2. Processing of national sample survey : 
consumer’s expenditure data 


Tho Indian National Sample Survey (NSS) Organisation is engaged in con¬ 
ducting repetitive fact finding sample surveys about various aspects of tho Indian 
economy. The Indian Statistical Institute is in charge of tho design and analysis of 
the surveys, while the data are collected by the NSS Field Directorate of tho Govern¬ 
ment of India. The surveys aro conducted in different ‘rounds' spread over periods 
of six to nine months. Stratified multistage sampling schemes are generally adopted, 
first stage units being selected on some occasions with probabilities proportional 
to some measure of ‘size' and with replacement. An essential feature of the sampling 
design is the use of two (or more) independent interpenetrating half-samples (sub¬ 
samples) of identical design, with one team of investigators associated with each set of 
sub-samples. 


In tho consumer’s expenditure survey, the NSS collects from sampled house¬ 
holds, in addition to other particulars, the quantities consumed in a month, of various 
items together with the values of tho consumed items. The information so collected 
. f rorl nn mi nohod cards For each household there is ono master card which 

X- - - a—-a. - a. 

to which it belongs, and some basic data for the household-the sise of tho househ. . 

;:;::;!r,c c aul:' «*——- - - the ‘■ u * n 

tity and value of the consumed item. 
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Before tabulation these cards pass through several processing stages during 
which the additive fields (quantities and values) on the master cards and the detail 
cards are multiplied by the appropriate weighting factors, as required by the sampling 
design; the classificatory fields arc properly ended: tho overall monthly expenditure 
per person (X) is computed for each household and punched on all the cards for the 
household on an assigned field. 

Tho next stop in processing is to form the fractile groups. Tho fraetile groups 
are formed on the basis of the variable : X = overall household expenditure per |>orson 
per month, by equalising the estimated number of persons (totals of weighted house¬ 
hold sizes) in each fractile group. The whole sot of sampled households is to be arranged 
in increasing order of X and divided into, say, m =» 20 groups, each group accounting 
for 5% of tho estimated total population. (It may often be necessary to split up the 
highest and tho lowest groups into smaller sub-groups; each accounting for say. 1% 
of tho population, but we shall not discuss that in this paper). 

Two sots of fractile graphs are generally required, (i) ono set for the whole of 
India, separately for each half-sample, and by pooling the two half-samples and (ii) 
one set for each state, separately for each half-sample, and again pooling the two 
half-samples. Accordingly, each sample household will belong to four fractile groups 
—two for all India tabulation—(ono for tho particular half-sample to which tho house¬ 
hold belongs, and tho othor for the two half-samples combined) and another two for 
stato-wiso tabulation. 

A completely mechanised proccduro for determining the fractile terminal points 
for forming tho fractile groups is described in Section 3 of this paper. 

After formation of tho four sets of fractile groups, tho totals for tho weighted 
quantities and values of consumption are to bo obtained for each of these four ways 
of classification. In normal tabulation, tho group identification codes are punched on 
cards, the cards are sorted by these codes, and tho tabulator is set up to print the total 
whenever the comparison of the group identification code for a cart! with that for the 
noxt card shows an unequal result. This would be extremely inconvenient and un¬ 
economic in our case. Wo describe in Sections 4 and C two alternative methods of 
tabulation which avoid tho punching of fractile group codes on cards and at tho samo 
time ensures considerable economy of card passages through tabulating machines. 

3. A MECHANISED PROCEDURE FOR DETERMINATION OF FRACTILE POINTS 

The first stop in the tabulation programme is tho determination of tho four 
sets of fractile points. A completely mechanised procedure has boon developed 
for tho purposo, requiring tho use of only a sorter and an unrelated program mo Tabu¬ 
lator. Essontially, the procedure is as follows. 

Tho household master cards are sorted according to states, and then in ono 
run through tho Tabulator, the totals of the weighted household sizes are obtained 
for each state and for all India; in each case, separately for tho two half-samples, and 
tho combined full sample. These totals are summary punched and by dividing them 
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by TO — 20, on a calculating punch, ono gets, the estimated population or ‘content’ 
in each of the fractile groups, for each of the six typos : (half sample 1, half sample 2, 
combined full sample) x (state, all India). 

The household master cards are next sorted in increasing order of the per capita 
overall monthly expenditure (A') and fed into a Tabulator. (If there are multiple cards 
with a common value of A', these can be arranged among themselves in any objective 
way). To determine the all India fractile points separately for the two half samples 
and the combined full sample, the three predetermined ‘contents’ for a fractile group 
are first enterod negatively on three separate counters, one assigned for half-sample 
1, another for half-sample 2 and the third for the combined full sample. From each 
card, the weighted household sizo is read and entered positively on the two counters 
appropriate for the card. The Tabulator is set up to stop card feed as soon as any 
of the counters has a positive balance, and start programming selectively, on Minor, 
Inter or Major levels, depending on which of tho counters arc positive. The Tabu¬ 
lator is instructed to print or summary punch tho value of A (tho fractile terminal 
point) and other required information, at every such programme start. The procedure 
is automatically ropoated for each fractilo group. Tho state fractile terminal points 
aro determined in a second run, after separating tho cards by states. 

Tho dotails of tho programming instructions are given below : 

Counter groups (1.1), (2.1), (3.1) and (4.1) are allotted for half-sample 1; (1.2), 

(2.2) , (3.2) and (4.2) for half-sample 2, (1.3), (2.3), (3.3) and (4.3) for tho pooled full 
sample respectively. Counters (1.1), (1.2) and (1.3) aro to add tho weighted household 
sizes from the household mastor cards belonging to half-sample 1, half-sample 2 and 
the pooled full sample respectively. To start with, they arc to mini*.* tho ‘content* of the 
corresponding fractile groups, read from summary cards made previously, and also 
stored on counters (2.1), (2.2) and (2.3) respectively for further use. Counters (1.1) 

(1.2) and (1.3) are balance-controlled. Countors (4.1), (4.2) and (4.3) arc used for regis¬ 
tering group indicative information which goes to identify the typos of fractile groups 
(stato/all India, half-sample— 1 or 2/pooled sample). 


When counter (1.1) becomes positive, an impulso is supplied to start Minor 
programme, one card cycle later. Similarly, programmes at Inter and Major levels 
are called for by tho positive condition of countors (1.2) and (1.3) respectively. 

In the card cycle during which a programme at Minor level is called for, 
counter (3.1) is instructed to add a digit 1; counters (3.2) and (3.3) to do likewise 
in the card cycles during which programmes at Inter and Major levels respectively 

are called for. 


In tho card cycle during which a programme at either Minor or Inter level is 
called for, counter ( 5 . 1 ) is to register the value of X punched in the Householdl master 
card passing through the second reading brushes during that cycle. Counter (u.2) 
is to do a similar operation when a Major is called for. 
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Four programme stops are called for and tho following cycle chart gives the 
instructions to be obeyed during these steps. 


CYCLE CHART 


step 


level of control 


minor 

inter 

major 

final 

1. 

rood out counter 2.1 

read out counter 2.2 

read out counter 2.3 



«nd minus counter 

and minus counter 

and minus counter 



l.l 

1.2 

1.3 


2. 

— 

— 

summary punch tho 





contonts of counters 





4.3. 3.3 and 5.2. 


3. 

summary punch tho 

summary punch tho 




contont* of counters 

contents of counters 




4.1,3.1 ond «.!• 

4.2. 3.2 and «.!• 



4. 

(a) road out counters 

(a) read out counters 

(a) road out counter 

(a) resot all counters 


4.1, 3.1 and 3.1 

4.2, 3.2 and 3.1 

4.3. 3.3 and 6.2 



(b) print 

(b) print 

(b) print 

(b) programme stop 


(c) reset countor 3.1 

(c> ro<ot counter 5.1 

(e) roaet counter 5.2 



(d) programme stop 

(d) programme stop 

(d) programme atop 



• summary panelling in slop 3 is ou tl.o same card field os in step 2. 

Tho summary cards obtained during this run through tho tabulator givo 
tho fraotilo points for tho throe all India tablos. At tho end of tho run tho summary 
punched card, arc removed and filed properly. Tho household master cards are then 
sorted and separated by states, and in front of tho pack of household master card, 
corresponding to each state, the cards giving the 'contents' of fraotilo groups for tho 
tluce sots of tablos for that state are placed and the tabulation ropoatod separately for 
each state with tho same control panel wiring as before. This second run gives tho 
lractilo points for the tliroo sots of fractile groups for each state. 

After tho determination of fractile points, tho totals of the weighted values and/ 
or quantities consumed of different items have to bo obtained for each of the si, 

soDarat I f T" 1 India - tW ° "“'““P 1 ** <» < 2 > *"« combined ,3, and 
r 0 ri:ir h m ^ f0r th0 tWO <«)-<*) and combined 

If v, a a r requ ‘ re S,:t SOparttt ® ,abulalor ™ns, involving tho passage 

of each detail card four times through a Tabulator. This is because the fraetdo 
groups are formed independently for each state and half-sample and the all-Ind a 

S ftdding th0 81816 tabl6S ' nor can the 

first is i orked * get round this difficuity - Th ° 

a Tabulator, certain summa^ ca^ a Jmade'^ZThi h^ ^ 

tables can bo prepared later This method ™ ^ ch h ° S,X Sets of ^ 

attachment. ^ tabulator with summary punch 
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When tlio number of cards is not so large, one can use another method which 
wo shall call the Unrelated Programme Method because one has to use an unrelated 
variable Programme Tabulator similar to IBM accounting machine type 421. The 
processing is simpler, because no summary punching is involved, but in this method, 
each detail card has to l»c passed twice through the Tabulator; once for getting the 
three all-India Tables (1 )-(3) and a second time for preparing the three sets of state 
Tables (4)-(6). 

A special feature of both tho methods is that the fractile group codes need 
not be punched on cards, because programming is initiated not by an unequal com¬ 
parison of code punches on one card and the next, but by the sensing ol specially 
inserted programme cards. The programme cards contain the fractile group 
identification number and the fractile terminal point and can be prepared either 
manually or summary punched as described earlier. The two methods are described 
in greater detail in Sections 4 and 5. 


4. Thb summary punch method 

The basic motivation hero is to economise Tabulator usage. Consider tho detail 
cards for a particular half-sample of a particular state. These cards will contribute 
towards the totals for : (1) all tho 20 fractile groups for the particular state and the 
particular half-sample. (2) all the 20 fractile groups for tho particular state based 
on the two half-samples combined, (3) all tho 20 fractile groups for nil India for 
tho particular half sample and finally. W all the 20 fractile groups for all India 
based on the two half-samples combined. If these basic 80 totals are available for 
each state and each half-sample, all the six sets of final table, can be obtained from 
them. If tables are to be prepared separately for 15 states (or geographic.I areas), 
one would then have to prepare a total of 80x2x15 - 2400 summary cards f.om 
which tho final tables would be made. 


This can bo organised in the following way : 


j. ms van ov --- - — 

The detail cards are sorted by half-sample (major) X state (Inter)XoveraU 
monthly expenditure per peso., (minor) classification. Cards for each half-sample X 
state group are kept separated. 

Programme cards with special designation are made for each of the (15 + 1) 
*3X20 = 960 fractile points, giving the fractile group identification code, state 
sub-sample code and the fractile terminal point for each. 

cular state, the two half-samples combined (3) ““ 1 Irranged in increasing 
gramme cards preceding tho corrcspondmg dotad cards. 
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The merged cards are fed into a Tabulator. The Tabulator is instructed 
to: (i) accumulate the weighted valuo/quantity figures from detail cards on assigned 
counters (ii) start programme whenever a programme card is at the second reading 
station (iii) print out and summary punch group indicative information (fractile group 
number, stato, half-sample code, fractile terminal point etc.) and accumulated totals 
and reset the counters. 

After all tho cards for a particular state and half-samplo are passed through 
the Tabulator, the programme cards are separated and the whole process is repeated 
on cards for other state X half-sample group. 

The final tables are obtained from the summary cards in a similar manner. 
To print tables by half-sample (Major) xstatc (Inter) x fractile group (Minor) classi¬ 
fication, the summary cards are sorted by half-sample (Major) xstato (Inter) X overall 
monthly expenditure per person (Minor) groups and then mergod with corresponding 
programme cards. To prepare tables by state (inter) X fractile group (minor) classi¬ 
fication, the previous programme cards arc removed, tho detail cards for the two half¬ 
samples are merged, and then the appropriate programme cards are noxt filed. All 
India tables are obtained in exactly the same way, in two other runs. 

Tiie unrelated programme method 

To prepuro the three all-India tables by this method all tho detail cards are 
sorted in ascending order of ovorall monthly expenditure per person and SO are tho 
programme cards giving the three sets of all-India fractilo points. These two decks of 
cards are then merged together, so that the programme cards preccdo the correspond¬ 
ing detail cards. Theso cards are then fed into an unrelated programme Tabulator. 
Tho weighted value/quantity figures are accumulated selectively on three sets of 
counters separately for the two half-samples and the combined full sample. Tho 
Tabulator is set up to start programming whenever a programme card is sensed at the 
second reading station—at tho Minor level if tho prograinmo card is for the first half 
sample, at the Intermediate level if the programme card is for the second half sample, 
and at tho Major level if the programme card is for the combined full sample. An 
unrelated variable programme Tabulator similar to tho IBM accounting machine 
type 421 is essontial because the three classifications are independent, and not hie- 
rarchial. At any lovel of programming, the appropriate group indicative information 
and totals accumulated on appropriate countors are printed out and the relevant 
counters are reset. 

To prepare state-wiso tables, the cards are separated out by states, appropriate 
programme cards are filed, and the above operations are repeated. 

6. Cost comparison 

Wo have described three fully mechanised procedures above; namely, 
(1) the traditional Fractile Group Code Punch Method, (2) tho Summary Punch and 
(3) the Unrelated Programme Method. In addition, we shall consider a fourth semi- 
mechanised procedure, which we shall eall (4) the Cumulative Method which was 
suggested by Professor Mahalanobis. In this method, the detail cards are arranged in 
53 
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increasing order of the overall monthly expenditure per person and fed into a 
Tabulator, to obtain for each household, the accumulated totals of the weighted 
quantity/value figures, without resetting the counters, separately for the two-half¬ 
samples and the combined full sample. We need two runs; one run for all India table 
and another run for the state-wise tables. For the state-wise table, the cards, of 
course, are separated by states. The final tables are derived by manual computation 
from these basic tables. It is instructive to compare the costs of these four different 
methods of processing. 

The cost will naturally depend on the number // of households sampled, 
the number of items for which tabulation is required, the counter capacity of the 
Tabulator used and the number of significant figures required for the totals. Table 
1 below shows the relative costs of the four methods, with the cost for the summary 
punch method as base = 100, for// = 4.000, 8,000 and 10,000 households. We have 
considered tabulation of six items, on an IBM accounting machine typo 421 with 
100 counter positions. These figures have been computed by taking into account tho 
card passage time and programming time on the Tabulator and all auxiliary machines; 
and valuing single card time on the sorter, reproducer, collator and tabulator in the 
ratios 1 : 15 : 5 : 34. The figures given in Table 1 arc nevertheless merely indicative, 
showing broadly the relative costs for the different methods. 

TABLE I. COMPARATIVE COST OF FOUR METHODS OF 
PROCESSING FOR FRACTILE GRAPHICAL ANALYSIS 
Ba»o : Coat for summary punch method — 100 


numbor of sampled households 


method - 

4000 

8000 

10000 

1. nummary punch 

100 

100 

100 

2. unrolatod programeno 

101 

121 

I3G 

3. •cumulative 

I3S* 

108* 

102* 

4. code punching 

202 

WO 

283 


• oxcluding cost for subsequent manual processing. 


Though the figures given in Table 1 arc admittedly rather gross, it enables us 
to reach certain broad conclusions. The Summary Punching Method (1) obviously 
. , . a ♦ I,, o„rl it hofomes relatively more and more advantageous as the number 

1" u. u— - <« '■ 

more costly, but the increased cost may bo more than offset by the s.mphc.ty of tho 
I , 0 . 1 , rlir.ctlv yields the final tables and does not requ.ro preparation of sum- 
method which The Cumulative Method (3) is costlier than either 

:,xr-™. - »■•*“ 

(4) is the least efficient and should never bo used. 
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HIERARCHICAL AND p-BLOCK MULTIRESPONSE DESIGNS 

AND THEIR ANALYSIS 


By S. N. ROY and J. N. SRIVASTAVA 
University of North Carolina. USA 

1. Introductory remarks on multiresponse designs 

IN GENERAL 

In any planned experiment what wo capture first under our sampling scheme 
is a set of experimental units and. according as we study each unit on one or several 
responses or response types, tho experiment is called a uniresponso or a multiresponse 
experiment. As already stated olsewhore. the overall objective of the oxporiment 
being what it is. namely the study of tho relationship betwcon tho set of responses and 
tho set of factors and also, in a sense, among the resi>onse3 themselves, an appropriate 
design for the allocation of tho units has to be made with an eye to this overall objec¬ 
tive. Till now, while choosing a design not much consideration has been given to the 
multiresponse aspect of tho experimentation, the choice being usually mado as if we 
had only a singlo responso under study and we wanted to carry out that study in 
a reasonably efficient mannor, dofinod and described in standard books. Also, till 
now those that have considered tho analysis and interpretation of multiresponse experi¬ 
ments, including tho prosont authors, have merely taken over such designs, and then 
assumed that each experimental unit is studied on all responses or characteristics and 
then carried out tho analysis accordingly. Howcvor. a little reflection and oven 
a slight acquaintance with oxporimcntal situations will indicate that in many such 
cases it is neither necessary nor oven feasible to study each unit on all characteristics. 
This immediately suggests that evory design has two facets, one relative to the treat¬ 
ments or factor-level combinations and the other relative to tho responses or variates. 
For uniresponso problems the latter facet, of courso, is absent. Tho first one is con¬ 
cerned with the allocation of the experimental units over tho treatments or factor-level 
combinations, but, even here, the other aspect, relative to variates, may well plan an 
indirect role. In other words, even this allocation may have to be made in different 
ways according ns tho overall objective is one of uniresponse or multiresponse study. 
This paper discusses two classes of multiresponso designs, to bo designated ns tho 
hierarchical and the p-block designs, and in a following paper 1 another general class to 
he designated as designs that are variate-wise incomplete and may or may not bo. 
in addition, treatment-wiso incomplete will be discussed. For the analysis of the two 
classes of this paper, a step-down procedure is suggested whilo, for tho analysis of the 
class of tho next paper, any one of the procedures elsewhere* claimed under group I, 
namely, the “trace” or tho A-criterion or the largest root criterion may bo used. 

1 Srivastavo, J. N. (1963) : Incomplete multiresponso designs, (to nppoar in £<inl7<y<i). 

* Roy. S. N.. Gnnnodosikan, R. and Srivastava, J. N. : Multifactor multiresponse experiments 
with continuous responses under tho customary model, (being processed for publication os a mimeograph 
iu n series sponsored by tho Boll Tolephon© Laboratories and tho Rothnmstod Experimental Station). 
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2. General description of hierarchical designs 

AND THE PROBLEMS UNDER THAT CLASS 


Suppose that, on consideration of relative cost or difficulty or on other consi¬ 
derations based on both a priori information, the different variates or characteristics 
have been arranged in a descending order of importance (for operating purposes) 
such that, for any pair of variates, it is known which one needs to bo measured on a 
larger number of experimental units. Suppose there are p variates that arc named 
V v r # . .... V p in the above order, and suppose these are measured respectively on 
the sets of units U x , U 2 , .... U p that are not necessarily disjoint. Let U t consist of 
tij experimental units. 


The multiresponse design, determined by (£/,, U t , .... £/„), will bo called 
hierarchical if and only if £/, P U a 3 ... 3 V p . Consider the set Uj. This, as usual, 
can be divided into blocks through homogeneity or similar considerations for the 
variate Vj. The allocation of treatments together with the set of blocks, over U t , 
defines a (univariate) design Dj over U t . The hierarchical multivariate design will 
then bo denoted by 



D - (D„ D t . D p ), 

... (1) 

under the condition that 

D U,+ lt j - 1,2.p-1. 

... (2) 

In set notation define 

U] = U,-U^ lt j=* 1,2.p-l, 

... (3) 

so that U p = U p . Then for j 

=s 1,2, ..., p, C/J represents the set of 



nj =» rij— nj+ u (n p+l « 0), 

... (4) 


experimental units on which only the variates F„ F 2 , .... Vj arc studied. To deli¬ 
neate the problems and describe the procedure we have to use some further notation 
as follows. Let Z l r denote the n' X 1 vector of observations on the r-th variate 

(r = 1,2. j; j = 1,2 . p), that are made on the n ' units in U). If Y f (j = 1 , 2, 

...,p) denotes the n t x 1 vector of observations on the n f units studied under the j-th 
variate, then we can writo 



Also let Z>. u = 1, 2. V, r - 1.1. j: *=‘- 2 ."»> <lenotc tho *; th 

„f 74 On each unit in Uj (j = 1. 2.p) the j observed values (on tho different 

variates) will he supposed to follow a multivariate normal distribute with a jxj 
dispersion matrix E,. It is clear, that for all j < p, S, is the (i*,') top left hand 
submatrix of the total (pxp) matrix X,( - X, say), on all tho p variates. Given any 
single variate V„ the expected values of the observations on V, will be supposed to 
involve the n,, x 1 vector of parameters (m,X 1). with components (5;,. ) such 


thiit 


E(z),) = (a*,)' 


... ( 6 ) 

for all permissible k,j and s (i.e., j= 1 , 2 ,..., k, k — 1, 2, ■ ^ 

where a), is a column vector of known constants given by the design D, 
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The null hypothesis 7/ 0 on the 5’s is then supposed to bo given by 

Ho : Q (<P, mCfo —0] = Q H„ (say). ... (7) 

where Cj is an (SjXmj) matrix and 0 is an (SjX 1) vector. 

Note here that an attempt to test a hypothesis posed in the form (7) (where 
the Cj *s might be different for the different j’s) may ap|x*ar t«* contradict certain 
current assumptions. But we shall now bear in mind two points. First, that the 
expectation model here is not the same .as the standard one; second, that the attempt 
to obtain a step-down procedure for testing the // 0 of (7), transform H 0 in a natural 
manner into an //£ given by 


ir 0 : [ Z, . D, 0; - 0 ) - £) //^ (say,. 


(«) 


whore D t is a known «jX«n t matrix. 0 an Sj x I vector ami 8 , a //i, x I vector of un¬ 
known parameters given bv 

" « “1 


e. 


0 . 1 , 2 . .... />— 1 ; 


« , 

_ J 

with '■“1.2 . j: 

and flj, is the r-th element of the vector p,. defined by 


(0) 


( 10 ) 


ft 




•* 


L ff uu j 


... (ii) 


Furthermore, this attempt also turns up that, on any uniton which at least up to (; +1) 
variates have boon studied. tho(j+l)-th variate, given the others, is conditionally distri- 
buted as a normal variate with variance given by |r J ,,|/|Z,| = (say), 
(j ^ o, 1. 2 .p— 1 ), and the expectation given by 

E{V f+' I . Y i) 13 »•/♦!+*} fit (say), ... (12) 

j — 1. -. P-1, 

where FJ is a matrix, to be given in the next section, in terms of (F,. ..., F.)and where 
B t+v of dimensions (» >+1 ) x ( »«/). is given by 


A{+' 


... 

*i M - * • 

• • • 

. 

and /if, which is an wi.xuj matrix. 

by 

Af 




(13) 
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For j = 0, i.o., at the first stage, (12) reduces to 



We now have the problem of testing the H' 0 = p) HI, of (8) under the model (12) 

and we note that the testability of H oj of (7) is thrown back on that of its equivalent 
HI,. Assume that H1, is testable (the conditions for which will be discussed later in 

this chapter), denote by 4b the usual least squares estimate of of (8) under the 
model (7). and by W, the dispersion matrix of and by p\ the rank of B,, by p' the 
rank of [Y,: BJ and by r, that of D } and let s) be the usual error mean square in the 
least squares estimation at this stage. Then it turns out that under // l, 

F 3 <' n i-Pi > W i l ... (15) 

' *! 

has an F-distribution with d.f. r, and (n,—p' f ), and that the F/s (under HI) are inde¬ 
pendently distributed. The step-down procedure suggested is as follows : 

Accept // 0 , i.o.. Hi if F, < p, j = 1,2, ... (16) 

and roject otherwise, where /i is given by 

if />[#■,</<» i-«. - < 17 > 

<-i 

To carry out this procedure we have all the necessary material except the 
expression of F, in terms of F,. .... F,. In the next section this expression will come 
out as a by-product while we sketch the mathematical justification for the procedure 
proposed. 


3. A SKETCH OF THE MATHEMATICAL JUSTIFICATION OF THE PROCEDURE 
PROPOSED (ASSUMING TESTABILITY OF /fj/S) 

Toward this end we try to find the conditional distribution of Y itl , given 

V Yj. In further extension of the notation used in (8), put 

i- v -i 




z>; 


+1 


j < i' = 1,2.p, 


L zf J 

whence F„ = V,. j = 1. 2,.P- Also we have (in terms of p.d.f.) 

P| Y ltl |F,.Fj] = P\Yi+i. l y >. F ’ >*'■ ,+|] 

_ n r,. y.. . 


(18) 


(19) 
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To compute the right side of (1!) we observe that the p.d.f. of Hie vector 

iZti'.ZH' . ZjtlJi* , , , 20> 

const exp •" ' ' 

where »ij = {[Z{r , -(«fr , >'W. .■)%*.)}• • < 21 > 

whence the conditional distribution of Zj*{ t% , given Ztf*. %}., . ,s 

const exp ••• ( 22 ) 

where nj is obtained by cutting out the last component of u\. It is checked that this 
conditional distribution is normal with a variance equal to |Ej + il/|2j|. and 
(conditional) mean given by 

E(Z}\\,.\ Z{\\ Z{+' . ZJ*>) = £T(ZiX\,.) (say) 

- <«J X\..Y l Y «■)' it .«'>' iA 

.Zj. +, )P). - 

being already given by (II). Thus, wo can write 


where A{ +l and y (k -= 1, 2, ... ,j) havo beon already defined by (9)—(11) and (13), 

by 

Zft* 


Zj|} is the vector defined by 


- Ztf 1 

m\ ::: • - 


0, 1. 2.p-l). 


(-’4.1) 


and ZN +l is the matrix dofined by 




Zft 1 

ztf 

• • • 

• • • 


i+i 


n 


,j-0,1,2,..., p-l. 


(25) 


Likowise, E'(Z k + x ) is obtained by substituting in the right sido of (23), k for j+1, in the 
superscripts of the it’s and of Z. Hence wc havo the conditional expectation equation 
for Yj +V given by (12), and it, thus, turns out that the Y J occurring in the right sido of 
( 12 ) is given by 

z;'+» 
z;'+* 


r ] 


( 26 ) 




(27) 


whore Z] k , in accordance with (25), is dofined by 

[ Z{, Z k x ... Z* 

Z ‘.- t Zln- t - ZU- t J 

From the above it is easy to chock the statements made in Section 2 on the conditional 
distribution F i+1 , given Y l# F 2 , .... F, and also about the independence of the F/s 
under Z/J. For the latter, note that, although the itself involves (Y x , ...,Fy), 
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its distribution under the null hypothesis is a central F and is independent of 

^ > .* n,u * henceof F v ...,Fj. The question of the testability of H 0 /s and eventually 

of Hq and hence of H 0 is one of great interest and will show up the extent to which 
the D/s of (8) and hence the C/s of (7) might differ for different variates. This will 
be discussed at some length in Section 5 following Section 4 which introduces the notion 
ol p-block designs in general (for/> variates) and considers, in particular, a hierarchical 
p-block design. The testability condition for this is the one discussed in Section 5, 
Irom which follows as a slightly special case what is wanted for Section 3. One pre¬ 
liminary remark at this point might be helpful. The testability condition for H' 0J 
under the model (12) is given by 



rank [B t Y] J. 


(28) 


4. MfLTIRKSPONSF. DESIGNS WITH p-BLOCK SYSTEMS 

To lix our ideas, let us start with an example. Suppose we want to experi¬ 
ment on v varieties of wheat, the characteristics under study being the yield and the 
susceptibility to pests. These two variates are well known to bo correlated. Before 
wo proceed further one might raise the question : why study the susceptibility, since 
the ultimate yield of a variety is all that matters ? This has several answers, one 
being that pest incidence may or may not bo uniformly independently controllable 
for all variates. A variety, which may bo a poor yiclder because of attaching a large 
number of pests, may become the highest yiclder when under pest control. 

Now, suppose that wo have bk{ = n, say) experimental units, and suppose that 
a fertility gradient suggests dividing these into b blocks of k units each. Suppose, 
further, that with respect to soil fertility, otc., the blocks are very homogeneous and 
between-block differences are very large, so that a BIB design (say) with these blocks 
will be quite efficient. The degrees of freedom for error in the ordinary analysis of 
variance are n— v— 6+1. The power of the i’-test for the equality of yields is a de¬ 
creasing function of b, provided that the other parameters are kept constant. How¬ 
ever, the introduction of blocks causes the error variance to drop so much that, ordi¬ 
narily, this would offset the decrease in power due to increase of 6, and, in fact, would 
push the power up. The soil fertility has, however, no effect on the post incidence, 
and, therefore, the above blocks cannot be expected to decrease the error variance for 
the pest susceptibility, and therefore, their introduction may actually decrease the 
power of the test relative to that variate. In other words, for the second variate we 
may use the completely randomized design (with 6=1). Thus, here we should have 
two block-systems, the first system consisting of b blocks, and the second having just 


one block. 

Multiresponse designs with p block-systems essentially deal with differential 
heterogeneity in the experimental material with respect to the various characteristics 
under study. If the appropriate stratification of this material relative to one response 
is very different from the appropriate stratification relative to another response, 
then two separate systems of blocks are called for, corresponding to these two variates. 
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The analysis of the above multircsponso design with two block-systems (mid 
in general of designs with p block-systems, if there are p responses), though not a 
special case of the usual model of multivariate linear hypotheses and analysis ol 
variance, can he handled by suitably generalizing the ste|Klown procedure. Instead 
of discussing the analysis for the particular situation when, on each unit, all the p 
variates are actually observed, wo shall present the same for the more general ease 
where a hierarchical design, in the sense of the last section, is dclincd over the units. 


5. Testability conditions of iiikkakciiioal dksions 

WITH p-BLOCK SYSTEMS 
Consider the condition? 

/«, \ 

rank (/I,) *= rank I I, j = 1, 2 , .... p. 

w 


( 20 ) 


These have been obtained from (28) by cutting out the parts containing TJ_,. which 
are stochastic variates. The conditions ( 20 ) will henceforth Ik* called the • control¬ 
lable part” of the testability conditions. 

We first examine how far (29) will imply (28). Notice that independent 

columns exist in YJ which are linearly independent of columns of llj. Also, it is 
clear that 

n. y: , 

> rank (B jt YJ). ... (30) 


B ‘ r ‘ ) 

\ l>i 0 / 


If (29) holds for some j. and (28) docs not hold, then in (30) we must have an inequality. 
Now Y] consists of n t ./'-vectors which are distributed independently according to a 
nontingular j-variate normal distribution. Thus the probability that the j-vectors 
in YJ will be mutually indc|>cndent and also linearly indc|H-ndent of the column vectors 
of ll t . is unity. Hence, with probability one. i.e. nlomost everywhere, wc must have 

rank (B > YJ) — j+rank (B,), for all j. 


rank 


(5?)<-(S)«-C?) 


= rank a.e. 

— rank (B„ YJ), a.e. ... (31) 

Comparing (31) with (30) wc thus find that, almost everywhere, the conditions (29) 
imply ( 28 ). 

Hence, in our further discussion, wc need to consider only the conditions 
(29), which represent the controllable part of the testability conditions. 

Let us now go back to (13) and write 


fii = 


A i 

A>S' 


(32) 


for I < k < j, j = 1,2, .... p. Then for all j, 

B i = (B{, B{, .... B>_„ Bj). 


54 


(33) 
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From (20), the above partitioning of B } induces a partitioning in D Jt say 

Dj = (D{, Di . Dj). ... (34) 

Since our discussion is completely general, we may now assume that, corres¬ 
ponding to each variate, there exists one system of blocks. The situation where 
we have just one system of blocks for all variates is evidently a particular case of the 
above. Similarly, for each variate, we may have a different set of treatment effects. 
Tin- vectors of parameters for the j-th variate ^ can, therefore, be written 




1, 2, ...,p, 


... (35) 


where t fb (say /« jt xl) is the set of parameters corresponding to the blocks, and {*^ ( 
(ol dimensionality tn J( X 1 say) is the set of parameters representing the treatment 
effects. Wo have, then, 

- mj, j = l, 2,... p. ... (30) 

Corresponding to (35), the vectors y. (1 < Ic j «= 1 , 2 , ... p) can then bo parti¬ 
tioned in the form 


[*]■ 


... (37) 


Next relative to the partitioning (35) and (37) of the vectors $>, and we have the 
corresponding partitioning of the matrices B[, this partitioning being obtained from 
(14). Thus we write, for 1 < k <j, j = 1, 2, ...,p, 

Bl-(BU, BU ... (38) 

Thus, in turn, induces a partitioning on the D l k \ 

D{ — (D[ b , Dl,). ... (39) 

If the hypothesis //„ concerns the treatments only, then so does the hypothesis IIq. 
Hence for 1 < k < j, j — 1, 2,.... p, we have 

D’** = 0 . 

and D> k = (0, Di"), ... (40) 

where 0 denotes a zero matrix of proper order. 

The controllable part of the testability condition can then be written, for 

1 < j < P> 

rank (B{>, B{ . Bj,, B{„ Bi „, ..., Bj,) 


(B{ b B' 2b B> )b B{, Bj, \ 
' \ 0 0 0 D{, Dj, J 


... (41) 


Two cases now arise. 


Case I : For j = 1, 2,... p, 

B{, = ... = Bj, = Bj say. ... (42) 

This is likely to arise in the great majority of experiments, where wo have a 
fixed set of treatments, the nature of the expected response for each individual treat¬ 
ment being exactly the same for each of the p variates under consideration. In fact, 
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it appears that up till now, in statistical litoraturo, this has boon tho model assumed 
for trontment effects in multivariate experiments. 

An examination of (41) shows that, for testability a.o., under the step-down 
procedure, wo must have 

- - - Vi - *>t *ay- ... (13) 

Thus we find that under the present model we cannot, at Uioj-th stage (j = 2./>), 

test different hypotheses for the variables I',, V t . .... V y The fact that, under (42), 
the j-th stage modol ( 12 ) degenerates in such a way that for testability the conditions 
(43) become necessary, will be referred to as tho “intrinsic confounding" of tho j 
variates in the j-th stage modol. 


Let ns now consider the effect of tho phenomenon of “intrinsic confounding" 
on the testability of the hypothesis //„. Because of (37) and (38), //„ reduces to 

+ - + SJ-i. .+ £*> - 0, j = 1. 2.p. ... (44) 

But //„ is C H \ it =0, j — 1,2, .... p. 

Writing in full, //’ is 



0 

0 

0 0 


■ 


0 "j 


j At®? 

D] 

0 

0 0 


u 

. 1 

0 


! Al®} 

... 

A*®? 


0 0 


u 

1 - 
1 

1 1 

• 

• 

. (4o) 

L fipxDf 

H 0 is 



fip.p-iDr Dr 

— 

1- 


• 

0 



~ c u 

0 • 

•• 0 

■ Ku 

-1 1 
1 

” 0 “ 




0 

Cu • 

0 

• 


0 




* 

• 

• 


• 


• 

1 • • 

.. (4G) 


0 

0 

C* _I 

- 


_ 0 





J ... ' --oy me rows oi iW. Then 

a sufficient condition that //„ implies H % 0 is that the vector space generated by the rows 
of 


(47) 


be the same ns V(C )t ). Similarly, a sufficient condition that //; implies // 0 is that 

(i) F(0>) 5F(jD*)„. => p ( Df) 

(ii) V(D!) = F(C«), j sb 1,2. p . - <48) 

Combnung the two, we find that (48) is a sufficient condition that H, and IK are equi¬ 
valent. Since (45) involves /?’s which are unknown, we do not possess a set of neces- 
sary conditions for the equivalence of H 0 and H' 0 . 
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Case II : B,’ ft B\, .... B are not all equal : An important example of 
this situation is the following one : Let the suffix t in the above matrices vary over the 
total number .V(= .«,Xfi 2 X ••• s w ) of treatment combinations of a factorial experi¬ 
ment in which these are m factors, the fc-th factor being at level s k . However, though 
the total number of treatments actually tried in the experiment is N, it may bo plausible 
to assume that certain higher order interactions are zero for each of the p variates 
involved. A situation, where B[ t , ..., B), may not be equal, will arise, if wo assume, 
for example, that, for variate V t , all 2-factor and higher order interactions are zero and 
the others are not negligible, for variate V t , all 4-factor and higher interactions are zero 
and the others are not negligible, etc. In such cases, even m u , will not bo equal. 

For testability, condition (41) will have to be verified. In many cases the 
matrices B' u$ ..., B‘, may have a part (as, for example, corresponding to the main 
effects, say) B {* which is common to all of them. This will lead to difficulties of a 
nature similar to those encountered under Case I. 

One remark will be needed hero. For certain special cases, the problems under 
Case I may be handled (and have been handled) by methods available in the present 
statistical literature using the known designs which are essentially raoant for univariate 
problems. But the problems under Case II can be tackled only under tho present 
development. The use of appropriate multiresponse designs is necessary, however, 
for all multivariate experiments that we want to conduct in an “efficient” manner. 

0. Nature of the multivariate designs for an important special case 

Consider now the part icular case when (47) is satisfied. Then, in //„, we can take 

D{ = C f ,'j= 1,2 . p. ... (49) 

For this special case, the conditions (41), in view of (42) and (49), reduce to tho 
following : 

rank («(*. B^ ..., Bj*. B{) - rank (“"“t - <*<» 


This shows that, at tho j-th stage, the design behaves ns if there are 

w», 6 -f ••• ••• 

block effects. If there is only one. viz., tho j-th variate, in tho picture, then tho blocks 
entering into the analysis would have been those which correspond to B{,,. This shows 
that our method of analysis introduces, in effect, a larger number of blocks at tho j-th 
stage (for all j) than arc present there from the consideration of the j-th variato alone. 
Thus, we have effectively a larger amount of latitude now. For example, let us con¬ 
sider a matrix C„ having m „-1 linearly independent contrasts. If we considered the 
j-th variate only, ignoring the rest, then tho condition for testability would have been 

rank (Bj». B{) = rank J . - ( f,2 > 

or, equivalently, the j-th stage design should be connected^ Comparing (52) with 
,50), we find that the connectedness is needed now in terms of a much larger number 
block effects. However, we should still expect the overall des.gn to be qmte 
complicated, since now we have j blocks passing through each urnt Furt * 6 ""°£ 
the concept of connectedness will have to be redefined in terms of j systems oblocks. 
(„ contrast to the present definition of connectedness in terms of ,ust one system of blocks. 




A STUDY OF THE FIELD COST FOR THE COLLECTION 
OF HOUSEHOLD CONSUMPTION DATA BY AN 
INTERVIEW METHOD 


By J. M. SEN (SUITA 
In Jinn Statistical Institute 


I. Introduction 

1.1. Genesis of the study. Along with the special Ininl-utilisntion experi¬ 
ments and socio-economic type studies, an auxiliary study on the cost of Held enume¬ 
ration. i.e. time taken in the tilling up of a consumption schedule was also carried 
out by the West Bengal field staff of the Indian Statistical Institute during the years 
1957-58 and 1958-59. These enquiries were taken up during the slacks in between 
crop seasons when the normal land-utilisation work had to he kept in abeyance. Two 
rural centres in Saint Ida and Bhalian in the district of Birbhum were selected for this 
purpose. Besides, the semi-urban section of Sainthia and the eitv area of Calcutta 
constituted two other centres. The rural centres comprised of compact blocks of 
villages of roughly three miles in radius around the night camp situated more or less 
at the centre of this block. 

The centres were chosen rather arbitrarily according to convenience and the 
surveys were spread over different parts of a year. The enquiry as ft whole could 
not thus he carried out as a single planned experiment. In fact, the accounting 
periods differ from centre to centre and the whole coverage is but a representation 
of ft few typical regions in the State of West Bengal. Nevertheless, some useful 
indications may well come up from a review of the material thus collected. 

1 .2. Object. A questionnaire for the collection of household consumption 
data consists of a number of blocks representing the different groups of consumption 
blocks items. The different blocks do not consume the same amount of time in 
collecting the necessary information by an interview method of enquiry. For some 
of these blocks, a lot of time has to he spent, while for others very little time is 
required. 

For the planning of an efficient survey, it must be of considerable interest 
to find out the block-specific requirements of field time. Obviously, consumption 
blocks with a lower coefficient of variation would require a relatively smaller size 
of sample compared to that required by blocks with a higher variability. Thus 
relative costs of field enumeration and the variabilities of the respective blocks will 
have to be considered jointly. The crucial point of investigation would thus be to 
ascertain, if for an estimation of the overall consumption budget, all of the blocks 
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need ho enumerated for each and every household interviewed or a number of house¬ 
holds could be skipped over in respect of particular blocks, whose requirements are 
smaller. Tt has to be remembered, however, that the journey time is an important 
component of total enumeration costs, while certain blocks dealing with the identi- 
icat ion particulars and demographic details also constitute an essential part of the 
enquiry whatever items of consumption are covered in a household interview. Against 
these overhead costs which represent a considerable proportion of total field cost, 
we have now to investigate if the skipping over of particular blocks in one or more 
households, is at all worthwhile. 

1.3. Central plan of the type study. It has already been pointed out that 
whatever be the item coverage, there are some basic information which are essential 
and must be collected from every household interviewed. These consist of the identi¬ 
fication particulars and the demographic details. Keeping these blocks as a compulsory 
and common feature, four separate questionnaires comprising different groups of 
blocks were drawn up and were employed in four independent surveys. These four 
questionnaire types were as follows : 

Questionnaire 1 (Q,) : (1-4) Identification and demography; (6) cereals; 
(7) pulses and products; (9) vegetable and fruits. 

Questionnaire 2 (Q 2 ) : (1-4) Identification and demography; (8) oil; (10) fish- 
meat-eggs; (13) milk and milk products. 

Questionnaire 3 (Q 3 ) : (1-4) Identification and demography; (11) sugar, 
salt, spices; (12) beverages, sugar, refreshments etc.; (14) pan, intoxicants, tobacco 
etc.; (15) fuel and light. 


Questionnaire 4 (Q 4 ) : (1-4) Identification and demography; (0) cereals; 

(7) pulses and products; (8) oil; (9) vegetable and fruits; (10) fish-meat-eggs; 
(11) sugar, salt, spices; (12) beverages, sugar, refreshments etc.; (13) milk and 
milk products; (14) pan, intoxicants, tobacco etc.; (15) fuel and light. 

A specimen schedule for the collection of consumption data along with the time 
records has been appended at the end of the note. 


Sainthia Centres. All these four types of Questionnaires (Q,)-(Q 4 ) with 
‘day’ as well as ‘month’ as the accounting units, were tried out in tho urban and 
also in the rural areas of Sainthia, Birbhum of West Bengal. Eight workers were 


assigned to each type of questionnaire with an accounting period of a ‘ day’ or a ‘ month’ 
and they were shifted to the other three types by a systematic rotation. This is 
given in Appendix Tables A.l and A.2. It will be seen from Table A.l that in 
the urban areas, 10 households for Questionnaires (Q,)-(Q 3 ) and 8 households for 
(Q ) were allotted to each worker in a sub-round of 4 days. In the rural areas, tins 
number was increased to 16 and 10 respectively. Each worker was asked to survey 
as in any of the households as they could manage out of this total allotment. 
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Bhalian Centre. The full Questionnaire (Q 4 ) only was attempted at the 
rural centre of Bhalian in the district of Birhhuni. with three accounting periods, 
namely, a day, a weok and n month. The allotment of sample units is given in 
Appendix Table A.3. It will be seen that particular and fixed days of tin- week were 
not chosen as accounting units. The selection was made at random out of the seven 
days in one week. 

Calcutta Centre. In Calcutta, Questionnaire (Q 4 ) with month" as the only 
accounting period was used. The city of Calcutta was split up arbitrarily into live 
compact zones, containing approximately the same number of households. The 
survey was carried out by three teams, each team consisting of one Inspector and 
five Investigators. Three Investigators, one from each team, worked daily in one 
of the five zones, while each Inspector had to cover all the five zones constituting 
the city. The sampling was done in two stages, census blocks slelcctcd with a 
probability proportionate to population representing the first stage units within 
which households were selected in the second stage. 

Net amount of time taken to fill up each individual block was noted in minutes 
at the foot of the relevant household schedule at the time of investigation, each investi¬ 
gator being provided with a pocket watch for maintaining these time records. All 
time spent in journeying between the block camp and the sample households or 
between one household to another has been considered as journey time and entered 
against the household at which the journey terminates. The time for returning to 
the block camp has been entered against the Inst household visited in tho day. 
Obviously the scheme does not involve any big journeys, i.e.. transits from one camp 
to another, all field costs representing activities within the camp coverage of 
approximately three miles in radius. 


2. Results of the experiment 

2 .1. Mean filling time for individual consumption blocks. Table 1 gives 
the mean filling time in minutes per household for different consumption blocks, 
based on different questionnaire types separately for Sainthia rural and Sainthia 
town, "hie the Centres Bhalian rural and Caleutta city refer only to Questionnaire 
5 ; ' “f ful1 ^schedule. The enumeration time per household relating to 
individual blocks ,n Questionnaires Q„ Q, and Q. are exclusive, except the identity- 
demography B ocks 1-4 which has been repeated in all the four questionnaire types 
Ihe corresponding number of households may be seen in Table 3 discussed hereafter. 

It will be seen that enumeration of the common informations Blocks 1-4 
takes considerable time, while generally, filling time for other individual blocks 
increases with an increasing length of the accounting period. 

I t JTJ* S0,U Y ndiCati ?“ alSO that fiUi "g «mc per household is some- 
what lc & >> in the rural areas than in the urban areas But this latter *• 

is too tentative considering the size of sample employed. Further exa^nTtloTof 
this aspect of enumeration costs would be worthwhile. * 
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TABLE I. MEAN FILLING TIME IN MINUTE PER HOUSEHOLD FOR INDIVIDUAL BLOCK- 
GROUPS WITH DIFFERENT ACCOUNTING PERIODS IN DIFFERENT CENTRES 




mean 

filling time in 

minutes 

per household 


blocks 

question¬ 
naire 
t \nA — 

Sainthia 

rural 

Sainthia 

town 


Bhnlian 

rural 

Culcuttu 

city 



day month 

day month 

day 

week month 

month 

(1) 

(2) 

(3) (4) 

(») (6) 

(7) 

(8) (9) 

(10) 


(1-4) identification and 

Q-l 

20.1 

21.6 

27.3 

43.1 






demography 

Q-2 

17.1 

20.3 

30.9 

30.1 







Q-3 

22.5 

24.2 

45.5 

22.7 







Q-4 

22.4 

17.1 

26.1 

30.9 

30.6 

30.8 

30.0 

21.0 

(0) 

cereals 

Q-l 

7.2 

II.1 

12.9 

19.5 







Q-4 

5.9 

10.4 

10.2 

17.9 

8.5 

10.7 

14.7 

10.2 

(7) 

pul~os and products 

Q-l 

2.5 

7.0 

4.2 

7.3 







Q-4 

1.9 

5.3 

3.1 

9.8 

2.7 

3.9 

0.0 

6.0 

(9) 

vegetable, fruits and 

Q-l 

4.2 

12.8 

9.1 

15.1 





nuts 

Q-4 

3.7 

8.5 

6.3 

15.0 

6.3 

8.6 

12.1 

15.4 

(8) 

oil 

Q-2 

3.5 

4.0 

4.3 

7.9 






Q-4 

2.7 

3.5 

3.5 

5.4 

3.7 

4.6 

4.8 

4.9 

(10) 

inoat, fish and ogg 

Q-2 

1.5 

4.9 

3.9 

11.4 





Q-4 

1.5 

5.3 

3.4 

10.6 

3.6 

4.9 

6.0 

6.9 

(13) 

milk and milk products 

Q-2 

2.1 

2.4 

3.4 

5.3 




3.5 

Q-4 

1.4 

2.0 

2.5 

5.0 

2.6 

2.7 

2.7 

(ID 

sugar, salt and spices 

Q-3 

Q-4 

5.9 

4.4 

13.8 

11.3 

9.6 

6.7 

16.1 

19.3 

6.1 

9.6 

13.4 

11.4 

(12) 

bovorages and rofresh- 
mont 

Q-3 

Q-4 

1.9 

1.7 

4.4 

2.6 

0.1 

3.0 

6.3 

0.5 

2.9 

3.6 

3.0 

5.4 

(14) 

pan, intoxicant and 

Q-3 

0.2 

7.9 

7.8 

10.6 


6.9 

8.1 

6.4 

tobacco 

Q-4 

5.2 

6.7 

5.7 

11.6 

6.0 

(15) 

fuol and light 

Q-3 

Q-4 

6.7 

6.0 

9.7 

7.8 

8.7 

7.7 

10.0 

12.2 

0.7 

8.6 

11.0 

0.5 


2.2. Effect of the length of accounting period on mean filling time for individual 
block-groups. It will be interesting to compare the mean filling time for the major 
food blocks based on different lengths of accounting periods as obtained in the different 
centres. Table 2 in sub-table (a) below gives the net filling time (exclusive of 
Blocks 1-4) in minutes per household while the corresponding coefficients of variation 
are given in sub-table (b). In estimating the averages, full data were utilised and 
block-groups for which more than one questionnaire was employed with an identical 
period of accounting, the data were pooled up for working out the averages. Thus 
for cereals and pulses, time-records were availal.le on the basis of Questionnaires I and 4 
in the Sainthia centres, while for Bhalian and Calcutta the data relates to Question¬ 
naire 4 only. Time required per household when month was taken as the accounting 
period is considerably higher than the same with 'day' as the period of 
Coefficients of variation are, however, more or less umform m the different 
irrespective of the accounting period chosen. 
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TABLE 2. MEAN FILLING TIME FOR DIFFERENT BLOCK GROUPS WITH CO-EFFICIENTS 
OF VARIATION AS OBSERVED IN DIFFERENT CENTRES WITH DIFFERENT 
ACCOUNTING PERIODS (ALL QUESTIONNAIRES POOLED) 




Sainthia 



Blmhan 


Calcutta 

block-groups 

rural 

town 


rural 


city 


day 

month 

day 

month 

day 

week 

month 

month 

(1) 

(2) 

(3) 

(4) 

(5) 

(0) 

<7> 

(8) 

(0) 

(a) 

mean filling limo 

in minutes per 

household 




I. corouls And pulses 

8.7 

17.2 

13.8 

27.2 

11.2 

14.0 

20.7 

10.2 

2 . vegetables and fruits 

3.9 

II.1 

8.1 

15.0 

0.3 

8.0 

12.1 

15.4 

3. oil, roout-fish-egg, milk 

0.3 

II.1 

10.8 

23.5 

9.7 

12.1 

14.0 

13.3 

4. sugar, salt, bevorages otc. 

19.4 

32.2 

28.0 

45.4 

20.8 

28.3 

30.0 

32.8 



(b) coefficient of variation 





1. coroult and pulsos 

43.0 

38.0 

40.1 

46.3 

34.0 

31.4 

43.0 

37.4 

2 . vegetables and fruits 

34.9 

45.3 

60.4 

37.3 

43.7 

38.2 

38.4 

45.8 

3. oil, mciit-flsli cgg. milk 

37.5 

40.3 

47.1 

32.2 

42.0 

30.0 

40.0 

39.9 

4. sugar, salt, beverages otc. 

36.1 

29.3 

33.9 

20.3 

32.3 

29.0 

27.5 

27.1 


2.3. Effect of the length of accounting period on the mean consumption rates 
of individual block-groups. Small accounting periods are usually believed to introduce 
an over-estimating bias in the estimation of consumption rates. The special studies 
conducted under a close technical supervision in Giridih in the year 1953-54, discussed 
in an earlier note by <T. M. Sen Gupta, A. Roy and J. N. Taluqdar (1959) did not, how¬ 
ever, reveal any pronounced bias of overestimation using accounting periods as small 
as one day. In the present experiments, the field work was carried out under normal 
supervision of a routine nature. It will bo interesting to review, whether any such 
bias is to be detected in the present material. 

Before computing tho average rates of consumption per capita per unit of 
stated time, it would be justified first of all to examine if the size of household as 
returned from the field is affected in any manner by the length of accounting period 
chosen. Table 3 below gives the average size of a household estimated on the basis 
of different accounting periods in the different centres of survey for each questionnaire. 
No systematic bias in the average size of a household seems to be associated with 
the choice of an accounting period. It is desirable, however, to eliminate the variation 
in the size of household and to reduce all consumption rates in terms of a per capita 
per month scale, to bring out the bias in the mean rates of consumption if am- in 
a fuller relief. 
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TABLE 3. AVERAGE SIZE OF HOUSEHOLDS WITH DIFFERENT ACCOUNTING PERIODS 
USING DIFFERENT TYPES OF QUESTIONNAIRES 


centre 

questionnaire 

number of households 

avorago size of households 

day 

woek 

month 

day 

week 

month 

(1) 

(2) 

(3) 

<*> 

(5) 

(6) 

(7) 

(8) 

Sitinthia (rural) 

Q. 

26 

— 

35 

4.23 

— 

5.29 


Q* 

39 

— 

35 

4.23 

— 

5.17 


Qj 

44 

— 

24 

4.68 

— 

4.54 


Q« 

27 

— 

23 

4.93 

— 

4.07 

Suinthia (town) 

Qi 

56 

— 

46 

5.09 

— 

6.02 


Q. 

62 

— 

67 

5.61 

— 

5.05 


q 3 

46 

— 

53 

5.07 

— 

5.26 


Q« 

30 

— 

26 

6.13 

— 

6.24 

Hhalinn 

Qi 

164 

112 

23 

4.91 

6.19 

4.06 

Calcutta 

Qi 

— 

— 

367 

— 

— 

4.00 


TABLE 4. MEAN CONSUMPTION VALUE (IN RUPEES) PER CAPITA PER MONTH FOR 
DIFFERENT BLOCK GROUPS WITH THEIR COEFFICENTS OF VARIATION 





Sainthia 



Birbhum 

Calcutta 

blocks groups items 

rural 

town 

vill-Bholian 

city 



day 

month 

day 

month 

day 

wcok 

month 

month 

(1) 

(2) 

(3) 

(4) 

(8) 

(8) 

(7) 

(8) 

(0) 

(10) 


(a) moan consumption valuo in rupees per capita per month 



0.7 

corouls, pulsos and products 

10.29 

9.00 

10.41 

9.13 

10.40 

10.32 

10.07 

8.25 

9 

vegetable*, fruits and nuts 

1.07 

0.77 

2.12 

1.27 

1.62 

1.31 

1.04 

2.68 

8,10,13 

oil, moat, fish, oggs, milk and 
milk products 

3.64 

2.06 

4.66 

3.28 

4.23 

3.74 

3.00 

0.77 

11,12. 

14,15 

bovoragos, sugar, salt, spices 
otc. 

4.63 

3.64 

6.12 

3.87 

4.17 

3.89 

3.10 

0.20 


(b) coofficiont of 

variation 

of consumption 

value 




0.7 

ccrouls, pulsos and products 

60.4 

73.3 

67.2 

60.8 

76.6 

62.2 

62.7 

78.7 


vegetables, fruits and nuts 

120 0 

92.1 

162.8 

115.1 

111.5 

91.0 

84.1 

124.7 

9 






8,10,13 

oil, moat, fish, oggs, milk and 
milk products 

135.3 

122.2 

167.5 

122.2 

94.1 

79.6 

82.1 

137.7 

11,12, 

14,15 

bovorages, sugar, salt, spicos 
otc. 

91.6 

70.1 

77.9 

69.9 

85.1 

66.4 

64.4 

104.6 


Table 4 in sub-table (a) finally gives the mean value of consumption in rupees 
per capita per month for each of the block-groups pooling up all data collected through 
one or more types of questionnaires. For instance, consumption of cereals »ndpulse, 
callable from Questionnaires 1 and 4 in the Samthm centres, wh.le the data 


w ore av 
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relates to Questionnaire 4 only in Bhalian and Calcutta. The corresponding co¬ 
efficients of variation have been given in sub-table (b). 

An overestimating bias in smaller accounting periods is clearly indicated 
almost without exception. 

2.4. Effect of the length of accounting period on total filling time and value cf 
the total food budget. Table 5 brings out the effect of the length of accounting period 
on the total filling time per household for the whole of the food budget inclusive of 
time spent in filling the common classificatory data in Blocks 1-4 and also on the 
total cost of food consumption expressed in rupees per capita per month. The mean 
rates have been given in cols. (3) and (4), while the same expressed ns percentages 
to the corresponding averages based on‘month’ accounting, have been given in cols. 
(5) and (0). It will be seen that total filling time per household for the smaller accoun¬ 
ting periods are substantially less, time required per household with day accounting 
being only about 54 per cent to 71 per cent of that required on a month-accounting 
basis. Consumption value per capita per month on the other hand is about 115 per cent 
to 127 per cent higher on a day-accounting basis compared to the same obtained within a 
month-accounting schedule. Consumption enquiries based on day-accounting periods 
are thus liable to a relative overestimation. 

TABLE 5. MEAN FILLING TIME IN MINUTES PER HOUSEHOLD [INCLUDING COMMON- 
INFORMATION BUT EXCLUDING JOURNEYS) AND TOTAL VALUE OF FOOD 
CONSUMPTION IN RUPEES PER CAPITA PER MONTH BY CENTRES 
UNDER DIFFERENT ACCOUNTING PERIODS 


accounting period centre 

filling 
time in 
minute* 
per 

household 

consumption 
value in 

nmPAi twtr 

indox with 'month'account¬ 
ing period an 1mi«o 

i \i|»vrn pv■ “ 

capita 
per month 

mean 

time 

ronaumption 

value 

(1) 

12) 

(3) 

(«> 

<fi> 

(0) 

day 

Sainthia rural 

56.8 

18.06 

71 

118 


Bhalian rural 

78.6 

20.42 

06 

115 


Sainthia town 

78.2 

19.92 

54 

127 


Calcutta city 

— 




wo ok 

Sainthia rurol 

- - 

_ 




Bhalian rural 

94.6 

19.26 

80 

108 


Sainthia town 






Calcutta city 

— 

— 

— 

— 

month 

Sainthia rural 

80.5 

15.31 

100 

100 


Bhalian rural 

118.8 

17.81 

100 

100 


Sainthia town 

144.2 

15.69 

100 

100 


Calcutta city 

101.2 

23.80 

100 

100 

2.5. 

The full questionnaire with a month accounting period. 



2.5.1. Field cost. We shall now deal with the results obtained from the full 
questionnaire on food (i.e., full schedule), namely Q t , with an accounting period of 
one month, which is the conventional period usually adopted in consumption 
surveys. Further, we shall confine ourselves to the three centres in the district of 
Birblium, namely (1) Sainthia rural. (2) Bhalian rural. (3) Sainthia town represen¬ 
ting a mixed population of the district. In Calcutta, the sampling design was a 
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two-stage one with census blocks as the first stage units. Birbhum material, 
however, represents a simple unistage sampling and the three centres have been 
pooled together to work out the parameters of field cost and variability of the 
consumption characters. 

The fifteen blocks comprising the full questionnaire of type Q 4 have been 
lumped into five important block groups, which are important by themselves and 
relating to which separate and independent questionnaires may be conceived. 
1 able 6 gives the mean enumeration time in minutes per household for different 
block groups for each of the three centres and for all centres combined. It may 
be noted here that the urban section of the Sainthia area is only nominally a “town”, 
there being hardly any difference in the consumption habits between these three 
centres. There may be some difference, however, in the geographical lay-out of the 
households and in that respect, journey time may be somewhat different between 
the so-called ‘urban’ and ‘rural' areas. Besides, occupation of the informants in 
the urban area may be different from the villages and the interviewing time spent 
per household, may be somewhat different. Time spent on journeys in minutes per 
household has been given at the foot of the table. Adding up journey with filling 
time we can get the total field working minutes per household. Total working minutes 
per working day has also been given below. It may be noted that we arc more 
interested in the total disposition of available working hours. As to the amount of 
working time available per working day is a question of relative efficiency in the 
field organization and is clearly beyond the scope of these ad hoc enquiries in the 
nature of type studies. 

TABLE 0. AVERAGE FIELD COST IN MINUTES PER HOUSEHOLD BA8ED ON THE FULL 
QUESTIONNAIRE (Q«) SURVEY WITH MONTH AS THE ACCOUNTING PERIOD FOR 

ENUMERATION OF THE FIVE IMPORTANT FOOD-BLOCKS AND FOR 


JOURNEYS WITHIN 

THE BLOCK 

COVERAGE 




timo 

spont in minutes per household 

blocks 

Sainthia 

Bhnlinn 

Sainthia 

all 

rural 


town 



n - 23 

n - 23 

n - 25 

n - 71 

(1) 

(2) 

(3) 

(4) 

(S) 

(i\) enumeration time 





1-4 : identification, demography 

17.09 

35.96 

30.88 

28.00 

G-7 : corcnls and pulses 

10.78 

20.04 

27.72 

21 .37 

D : vegetables 

8.52 

12.13 

14.90 

11.90 

10 : fish, meat and eggs 

5.35 

6.57 

10.56 

7.68 

8.13 : oil, milk and milk products 

5.43 

7.48 

10.40 

7.84 

11,12.14,15 : beverages, sugar otc. 

28.36 

35.91 

49.68 

38.31 

total 

80.52 

118.09 

144.20 

115.12 

(b) journey time 

59.48 

67.57 

33.16 

52.83 

total field working minutes per working day 

214.67 

237.22 

295.00 

248.42 
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2.5.2. Consumption rates. Table 7 in cols. (2)-(5) gives the corresponding 
mean rates of consumption value in rupees per household per month based on the 
full questionnaire (Q 4 ) with month accounting period for each of the three centres 
and combined. Mean rates of consumption for cereals and pulses are abnormally 
low in the rural areas of Sainthia which may be ascribed to the smallness of the sample 
size. The coefficients of variation for each of the centres and all centres combined, 
are given in cols. (6)-(8) and (9) respectively. It will be seen that the expenditure 
on vegetables and fruits and that on oil. milk and milk products are more variable 
than any of the other three block-groups, total variability for the entire food budget 
being of the order of 72.5 per cent. 

TABLE 7. MEAN VALUE OF CONSUMPTION IN RUPEES PER HOUSEHOLD RASED ON THE 
FULL QUESTIONNAIRE (Q.) SURVEY WITH AN ACCOUNTING PERIOD OF ONE MONTH 
FOR FIVE IMPORTANT FOOD-BLOCKS ALONG WITH THE COEFFICIENT OF 

VARIATION 


mean voluo in rupee* per household coefficient* of variation 


block group 

Sainthia 
rural 
m - 23 

Hhalian Sainthia 
rural town 

n m 23 a - 25 

com¬ 
bined 
n - 71 

Sainthia 

rural 

Hhalian 

rural 

Sainthia 

town 

com¬ 

bined 

ID 

(2) 

<3) 

(4) 

(3) 

(6) 

(7) 

<«) 

19) 

0.7 : corcnl* and pulse* 

36.06 

30.32 

50.83 

46.07 

37.2 

02.0 

71.8 

04.0 

0 : vegetables etc. 

2.92 

4.91 

6.54 

4.84 

86.0 

84.1 

123.0 

110.9 

10 : fish, meat, egg* 

3.35 

6.65 

5.23 

4.76 

63.0 

90.8 

80.0 

88.7 

8 . 1.1 : oil. milk & products 

7.23 

8.44 

13.99 

10.01 

127.2 

94.0 

192.9 

174.3 

11,12.14. IS : 

bovorogo*. sugar etc. 

14.11 

14.50 

20.71 

16.59 

02.6 

04.4 

70.2 

73.1 

all 

64.29 

83.91 

97.30 

82.27 

40.1 

60.5 


72.5 


2.6. Results of the full questionnairs compared with that of the. independent 
enquiries of corresjtonding block groups. It is now possible, on the basis of data collected 
through the full questionnaire (Q 4 with one month’s period of accounting) to build 
up synthetically so to say. field cost and consumption rates j»er household for block 
groups exactly corresponding to the same enumerated independently through Ques¬ 
tionnaires Q,. Q 2 and Q a . It will be interesting to examine how far these artificially 
built-up estimates based on the full questionnaire relating to the whole of Birbhum. 
agrees with the same obtained directly by independent surveys. It may be remem¬ 
bered that these independent surveys of specified block groups were enrried out 
only in the urban and rural centres of Sainthia. 

Table 8 below gives the estimated consumption rates in sub-table (a) and 
the estimated field costs inclusive of journeys in sub-table (b) obtained from the 
two different sources mentioned above along with their coefficients of variation. In 
estimating the total field cost, it has been assumed that journey time is proportionate 
to the number of households ignoring the density of households per unit of geographical 
urea. 
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ABLE 8. MEAN AND COEFFICIENTS OF VARIATION OF CONSUMPTION VALUE IN RUPEES 
AND CORRESPONDING FIELD COST (INCLUDING JOURNEY) BASED ON INDEPENDENT 
SURVEYS THROUGH Q„ Q„ AND Q a IN TWO CENTRES OF SAINTHIA COMBINED, 
COMPARED WITH THE RESULT OBTAINED FROM A FULL QUESTIONNAIRE 
SURVEY IN THREE CENTRES OF BIRBHUM COMBINED WITH 
MONTH AS ACCOUNTING PERIOD 


block groups 

independent surveys of respective 
block groups in Sainthia rural and 
urban combined 

corresponding rosults obtain¬ 
ed through a full question¬ 
naire in tho two centres of 
Sainthia and Bhalian 
(n - 71) 


n 

mean 

coefficients 
of variation 

moan 

coefficient* 
of variation 

(1) 

(2) 

(3) 

(4) 

<») 

(6) 

(i») consumption valuo 

in rupees 

per household 

per month 


1 . coroals, pulsos and vegetables 

81 

53.7 

66.8 

50.9 

65.9 

2 . oil, moat-fish-ogg. milk and 
products 

92 

13.8 

106.8 

10.8 

135.6 

3. bovoragos, sugar etc. 

77 

19.2 

68.7 

16.6 

73.1 


(b) field cost in minutes 

per household 



1. coroals, pulsos and vegetables 

81 

100.6 

34.6 

114.2 

31.6 

2 . oil, mout-fish-ogg. milk and 
products 

92 

73.7 

36.3 

96.3 

36.2 

3. bovorages, sugar otc. 

77 

90.4 

29.7 

119.2 

31.6 


It will be seen that the estimated rates, particularly the coefficients of variation 
obtained through the independent inquiries are in satisfactory agreement with the 
corresponding results artificially obtained from the full questionnaire data. This 
holds both for the consumption values as well as field cost estimates. 

3. Model schemes for a food consumption survey 

3 .1. Optimum allocation of sample households to different block-groups surveyed 
through independent questionnaires. The major object of these experiments, as 
already explained in paragraph 1.2, was to determine whether instead of using the full 
questionnaire and collecting data in respect of every block or block-groups from each 
household, an efficient sampling could be done by conducting separate enquiries 
independently through separate sub-questionnaires into which the full questionnaire 
may be split up. Obviously, such a procedure would lead to certain wastages in as 
much as the overhead costs like journeys and collection of common classificatory 
characters (like demography and household particulars) shall have to be incurred 
irrespective of the item coverage. On the other hand, if our objective is to attain 
a given precision for estimating the over-all food budget, it may be unnecessary to 
have the full size of sample for characters which have a relatively lower var.ab.hty 
or are themselves so unimportant, that great precision is not really wanted for them 
individually. There is likely to be some savings therefore by econom.s.ng the sample 
size by a judicious selection of the blocks comprising the different subquest.onnaires. 
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An optimum allocation of sample households among the different question¬ 
naires, i.e. block groups, in order to minimise the overall field cost for the estimation 
of total (all block) consumption value with a given margin of error has therefore to be 
considered. The problem of minimising field cost for attaining a given precision 
of the estimates when the cost variance functions are known, have been fully dealt 
with by Professor P. C. Mahalanobis in his interesting report “On Large Scale Sample 
Survey” published in 1944 by the Royal Society of London. The present problem is, 
of course, in many respects a different one where we have got a fixed size of sampling 
unit, namely a household, density of units per unit of area has been ignored and the 
entire field has been considered to be a single stratum. 

The square of the standard error * V' of the aggregate value of food consump¬ 
tion over 4 »* block-groups may be written as 

F = ... (1) 

and the overall field cost % T' as 

T = l,», ... (2) 

whore, <T i is the standard deviation, 1 { is the field cost per household and n, is the 
sample size for the i-th block-group. The cost function is assumed to bo in direct 
proportion to the number of households, the differential effect of the density of 
household per unit area on journey time being ignored. Then the percentage variation 

y/ V 

of the agreegato over ‘ i’-block-groups may be defined as C = X 100, where 
M i is the mean consumption rate for the i-th block group. 

For an optimum solution for obtaining a given percentage variability of the 
estimated aggregate at a minimum field cost 


ST 

Sn { 



Solving the above equations, we get 


... (3) 


T {StoV'M}* 
W* * 


and 




__ T °i 


3.2. Alternative schemes with combinations of sub-questionnaires surveyed in 
independent samples. We have now to consider as to what should be the criteria 
for choosing the blocks or block-groups as sub-questionnaires (S.Q.) for an independent 
sample enquiry. Obviously, the less correlated blocks should be lumped up for 
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increasing the efficiency of sampling. It should be worthwhile therefore to study 
the mutual correlations existing between the different blocks and block-groups, 
which should be an useful guide for our sub-questionnaire formation. 

I able 9 below gives the mutual correlation coefficients between all possible 
pairs among the five selected block-groups discussed earlier. This refers to the full 
questionnaire sample with a month accounting period in the three centres of Birbhum. 
With one exception in Sainthia (rural) between cereals-pulses with fish-meat-eggs, 
all the correlation coefficients are quite large and come out of the same order in all 
the three centres. The coefficients for the three centres combined are given in col. (5). 
So far as the correlated coefficients are concerned, there seems to be really little choice, 
in as much as practically all the above five characters are mutually correlated with 
more or less a high intensity. We have therefore to look for some other criterion. 
The most important, and almost the overriding one would bo in grouping up such 
characters as would be sensible from a practical point of view. For instance, wo 
may group together those characters which constitute the daily market-purchases into 
one and those purchased in monthly quotas in another sub-questionnaire. Besides, 
there must be some relevance in the sequence of questioning. It may be somewhat 
odd to question an informant regarding vegetables and then abruptly switch over to 
beverages. 

TABLE 0. CORRELATION COEFFICIENTS BETWEEN ALL POSSIBLE PAIRS OUT OF FIVE 
IMPORTANT FOOD BLOCKS. BASED ON THE FULL QUESTIONNAIRE (Q.) SURVEY 
WITH AN ACCOUNTING PERIOD OF ONE MONTH 



n/\n\bi n it f in 

n € 

if fmwlttilorh in nnirt 


correlation 

coofflciontn 



cojuuinmio 

II v. 

f m iuvu*uivin iii puna 

Sainthia 

rural 

Sainthia 

town 

Bhalian 

all 

contros 




(1) 

(2) 

(3) 

(4) 

(5) 

1. corools pulMOH 

X 

vcgetoblo otc. 

.6460 

.6907 

.6678 

.6705 

2. 


X 

moat, fish, otc. 

.1361 

.6778 

.3978 

.5192 

3. 

» 

X 

oil and milk 

.6291 

.5061 

.5842 

.1942 

4. 

M 

X 

othent 

.8521 

.7727 

.7780 

.7519 

5. 

vogotablo otc. 

X 

moat, fish, otc. 

.3469 

.7148 

.6653 

.6191 

6. 

tl 

X 

oil and milk 

.6125 

.8306 

.7017 

.7881 

7. 

ft 

X 

othon* 

.7027 

.8418 

.6036 

.7812 

8. 

meat, fish, otc. 

X 

oil and milk 

.3187 

.7502 

.4738 

.5284 

9. 

ft 

X 

othore 

.3394 

.8471 

.4776 

.5888 

10. 

oil and milk 

X 

others 

.8546 

.8860 

.6823 

.8322 


In the present study, we are thus left to choose the sub-questionnaire group- 
ings on general considerations. This has been done in the form of five schemes with 
one two, three, four and five independent sub-questionnaires (S.Q.), differently 
grouped up hut accounting in each ease for the whole of the food budget is enumerated 

below : 



FIELD COST FOR COLLECTION OF HOUSEHOLD CONSUMPTION DATA 441 

Scheme A : S.Q.l- (all blocks); Scheme B : S.Q.l- cereals and pulses; S.Q.2- 
rest. Scheme C : S.Q.l- cereals and pulses; S.Q.2- oil. milk and products; S.Q.3- 
rest. Scheme D : S.Q.l- cereals and pulses; S.Q.2- vegetables, fruits, fish-meat, 
eggs; S.Q.3- oil. milk and products; S.Q.4- rest. Scheme E : S.Q.l- cereals und 
pulses; S.Q.2- vegetables; S.Q.3- fish-meat, eggs; S.Q.l- oil. milk and products; 
S.Q.5- rest. 

Table 10 in cols. (7)-(10) below gives the parameters of field cost (/,) mean 
consumption (M { ) and standard deviation (<r,) per household corresponding to the 
different sub-questionnaires in each of the above five schemes, built up from the 
full questionnaire (Q 4 ) results, with month as accounting unit pooled over the three 
centres of Birbhum. 

The distribution of sample households among the different sub-questionnaires 
so as to ensure 5 per cent error of the total food cost in rupees per household at a 
minimum field cost has been given for each of the schemes in col. (9). 

TABLE 10. FIELD COST IN MINUTES PER HOUSEHOLD AND STANDARD DEVIATION OF 
THE CONSUMPTION RATES PER HOUSEHOLD BASED ON DIFFERENT SUB- 

QUESTIONNAIRES ALONG WITH AN OPTIMUM ALLOCATION OF SAMPLE 
SIZE FOR EACH. SO AS TO ENSURE AN ERROR OF 5% FOR THE TOTAL 

FOOD BUDGET 


scho- 

mo 

sub- 

ques¬ 

tion- 

noiro 

no. 

block groups 

fiold cost in minutes per 
household 

filling time 

- — jour- total 

con- demo- ney (f|) 

sump- graphy 
tion blocks 
blocks 

mean 

value 

in 

rupees 
ol con¬ 
sump¬ 
tion 

(A/<) 

standard opti- 
devia- mum 
tion (o<) olloca- 
of tion of 

value sujnplo 
con- house- 
sumed holds 
(in Bs.) 

(1) 

(2) 


(3) 

(4) 

(*) 

(6) 

(7) 

(8) 

(0) 

(10) 

A 

1 

613: 

all food blocks 

87.06 

28.00 

52.83 

167.95 

82.20 

59.64 

210 

B 

I 

0-7 : 

cereals and pulses 

21.37 

28.06 

52.83 

102.26 

40.07 

29.50 

120 


2 

815 : 

rost 

65.69 

28.06 

52.83 

140.58 

36.19 

35.80 

128 

C 

I 

6-7 : 

coreals and pulses 

21.37 

28.06 

52.83 

102.20 

46.07 

29.60 

120 


2 

8.13 : 

oil, milk and product 

a 7.84 

28.00 

52.83 

88.73 

10.00 

17.47 

76 


3 

9-12. 









. 


14-15 : 

rost 

57.85 

28.06 

52.83 

138.74 

26,19 

19.80 

09 

D 

1 

67 : 

coroals and pulses 

21.37 

28.06 

52.83 

102.26 

46.07 

29.50 

116 


2 

9-10 : 

vegetables, fish-meet 

• 










°gg s 

19.54 

28.06 

52.83 

100.43 

9.00 

8.91 

30 


3 

8.13 : 

oil, milk and products 7.84 

28.00 

52.83 

88.73 

10.00 

17.47 

75 


4 

11.12, 











14.15 : 

rost 

38.31 

28.06 

52.83 

119.20 

16.69 

12.13 

45 

E 

1 

6-7 : 

cereals and pulses 

21.37 

28.06 

52.83 

102.20 

46.07 

29.50 

119 


2 

9 : 

vegetables 

11.96 

28.06 

52.83 

92.85 

4.84 

6.66 

24 


3 

10: 

fish-meat-eggs 

7.68 

28.06 

62.83 

88.47 

4.76 

4.22 

18 


4 

8,13 : 

oil milk and product: 

i 7.84 

28.06 

52.83 

88.73 

10.00 

17.47 

70 


5 

11.12. 











14.15 : 

rost 

38.31 

28.06 

52.83 

119.20 

16.69 

12.13 

46 


66 
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Table 11 gives the percentage variabilities of the estimated mean expenditure 
for the five selected block-groups as obtained from each of the sampling schemes. 
It may be noted that although the overall error of the total food expenses is obtained 
as 5% in all the schemes, precision of the individual block-groups vary from scheme 
to scheme. Vegetables and fats (oil and milk) is estimated with an error of 8.06% 
and 12 . 10 % respectively when the full questionnaire is used, but the error increases 
respectively to 23.97% and 20.00% in scheme (E). Provided that such a high 
margin of error is permissible for relatively unimportant blocks, the advantages of a 
split-questionnaire method of survey is apparent from the results. In fact, it is at 
the cost of particular blocks which are made to suffer, and also taking advantage of 
blocks with a lower variability, that a split-questionnaire survey scores over the 
full-questionnaire survey, in spite of much heavier overhead expenses towards common 
information and journey account. 

Total field cost in terms of working minutes involved in each scheme has 
been noted at the foot of Table 11 and the same expressed as percentages to the cost 
of scheme (A) employing a full questionnaire have also been given below. It will 
be seen that by splitting the full questionnaire into four sub-questionnaires as in 

TABLE 11. PERCENTAGE VARIABILITIES OF THE ESTIMATED CONSUMPTION RATES 
FOR INDIVIDUAL BLOCK-GROUPS BASED ON DIFFERENT SCHEMES. EACH 
SCHEME ENSURING AN ERROR OF 5% FOR THE OVERALL FOOD BUDKOET 


percent a go variabilities of menn consumption rates 


block-groups 

schemo-A 
with ono 
question¬ 
naire : 
all 

blocks 

scheme-11 
with two 
question¬ 
naires : 
blocks 
6-7 A 
8-15 

schemo-C 
with threo 
question¬ 
naires : 
blocks 

6 7. 8. 13 A 
9-12, 14, 15 

scheme-1) 
with lour 
question¬ 
naires : 
blocks 

6-7. 9-10, 8. 
13 A II, 12, 
14, 16 

scheme-E 
with five 
question¬ 
naires : 
blocks 

0-7. 9. 10, 8, 
13 A 11, 12, 
14, 15 

(1) 

12) 

(3) 

(4) 

(3) 

(0) 

a 6-7 : coreols and pulses 

4.43 

5.71 

5.84 

5.90 

5.80 

b 9 : vogotablos. fruits, 

etc. 

8.06 

10.33 

14.05 

19.42 

23.97 

c 10: fish, mont, oggs 

6.09 

7.77 

10.71 

14.70 

20.80 

d 8,13 : oil. milk ond pro¬ 
ducts 

12.10 

15.40 

20.00 

20.20 

20.00 

o 11,12 

14,15 : bevoragos. sugar, 
otc. 

5.06 

6.45 

8.80 

r i kf | 

10.91 

R fill 

10.91 

ft 00 

total 

total field cost in working 
minutes 

5.00 

35271 

5.00 

31713 

O.hU 

28702 

o . uv 

27706 

28109 

field working days nt 248.42 
minutes por doy 

142 

128 

116 

112 

1 13 

percentage of cost to that 
in scheme A 

100% 

00% 

82% 

79% 

80% 
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scheme (D). a saving of 21% is effected. In the present experiment, 248.42 minutes 
of useful work was realised per working day in the field. This is obviously a factor 
which depends on the efficiency of field organisation. In actual live scale work, 
larger proportion of working time per day is likely to be realised. 

This direct saving of cost is, however, not the more important consideration 
in favour of a split-questionnaire enquiry. The reduction of the interview time is 
perhaps much more important. A full questionnaire enquiry lasting for 2-3 hours 
at a stretch must he quite taxing on the informant, who may have his own affairs 
to attend to. A short questionnaire would certainly be more congenial to him and 
as a result, the very quality of the date collected, is likely to improve. On the other 
hand, the investigator will he free to apply his mind and probe more deeply than 
could be expected in an exhausting session of a lengthy interview. 


Conclusion 

1. Under ordinary survey conditions, estimated consumption rates based 
on a day-accounting period has been observed to be higher than those obtained from 
a month-accounting period. The question as to whether a day-accounting over¬ 
estimates or the month-accounting underestimates, can be answered only after a 
careful investigation. 

2. Enumeration time for the filling up of different item groups or blocks 
in a food consumption schedule, varies with the length of the accounting period, 
increasing as the length of the accounting period increases. 

3. For estimating the overall rate of food expenditure per household with 
a given precision, a split questionnaire method of survey, introducing more than 
one sub-questionnaire each with a relatively smaller item-coverage, appears to bo 
more economic, when an optimum allocation of sample households is made by mini¬ 
mising the field cost. There is another consideration of equal importance. Apart 
from a reduction in the field costs, a questionnaire with a smaller item coverage is 
likely to be less taxing on the informant, whose willing cooperation ensures the quality 
of the data. Besides, the investigator himself will also be relieved of the exhausting 
task of going through a long course of interview in a single sitting. By separating 
out the various item-groups and covering them in independent enquiries, would no 
doubt prevent us from examining the consistency of the returns among the different 
blocks, but all other considerations seem to outweigh this handicap. 

4. An attempt has been made here to study the relative efficiency obtained 
by splitting up the questionnaire on total food into small sections, each of which 
is perhaps too small. Further studies on the survey of total household expenditure 
covered in separate enquiries relating to (a) food (b) clothing (c) education, medical, 
ceremonials, amusements and litigation against one single enquiry seem to be more 
interesting. 
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TABI.E A.l. ALLOTMENT OF WORKERS W,-W, FOR THE SURVEY OF QUESTION'. 
NAIRES Q,-Q« WITH ACCOUNTING PERIODS OF A "DAY” AND A "MONTH" 

IN URBAN AREAS OF SAINTHIA, B1RBHUM, 1050 

[total number of allotted households for Q«-Qj «- 10, the for Q« ^ 8 in eo«-h aub-jicriod of 4 day* ] 



quest ioiumi re typo 

account ing 
period 


sub-periodH of 4 day* 


30/10-2/11 

3/11-6/11 

7/IMO/ll 11/11*14/11 


(1) 

(2) 

(9) 

(4) 

(6) 

(0) 

Q. 

cereal*, pulse*. vegetable* 

day 

w, 

w. 

w. 

W, 



month 

w» 

w. 

w« 

W. 

Qj 

oil, fish, meat, eggs, milk 

day 

W. 

w« 

w, 

"'t 



month 

w. 

W, 

w. 

'V. 

Q* 

boverages. sugar, ete. 

day 

W, 

W, 

W, 

"*4 



month 

Wf 

w. 

Wf 

w. 

Q« 

all blocks 

day 

", 

W. 

Wa 

W, 

__ 


month 

>v« 


'Vt 

"•» 


TABLE A.2. ALLOTMENT OF WORKERS W,-\V $ FOR THE SURVEY OF QUESTION- 
NAIRES Q,-Q« WITH ACCOUNTING PERIODS OF A "DAY" AND A "MONTH- 


IN THE RURAL AREAS OF SAINTHIA. BIRBHUM, 1950 
[total number of allotted household* Q|-Q, - 16. the same for Q, - 10 in earl, sub-period of 4 daye) 



questionnaire type 

accounting - 
period 

15/11- 

18/11 

sub-period 

19/11- 

22/11 

of 4 day, 

/Mil. 

26/11 

27/11. 

30/11 


(1) 

(2) 

(3) 

(4) 

(5) 

(6> 

Qt 

corcolT, pulses, vegetables 

day 

w. 



'V, 



month 

W, 

'V, 

w. 

w. 

Qt 

oil, fish, meat. eggs, milk 

day 

W, 

w. 

w 8 

w. 



month 

w. 

'V, 

W, 

w. 

Qs 

bovorages, sugar, etc. 

day 

W, 

W, 

W 3 

w. 



month 

W, 

W, 

W, 

W 4 

Q« 

all block. 

day 

W 4 

W« 

W T 

W, 



month 

W 8 

w- 

W, 

W 8 
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TABLE A.3. TIME TABLE SHOWING THE DISTRIBUTION OF SAMPLE HOUSEHOLDS TO 
EACH OF THE FOUR WORKERS FOR ENUMERATING THE FULL QUESTIONNAIRE (Q<) 
WITH ACCOUNTING PERIODS OF A DAY, A WEEK AND A MONTH 


centre—Blialian, Birbhum 1956-57 
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RURAL 
URBAN 
Form 2 


INDIAN STATISTICAL INSTITUTE 

Pood consumption survey in »*Iect«d centre* of Went Bong*!, 1966. 
Reference period 


DAY 

MONTH 
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FIXED INTERVAL ANALYSIS AND FRACTILE ANALYSIS* 

By J. KETHURAMAN 
Indian Statistical Institute 
and 

University of North Carolina 
Summary 

The historical background and the methods of fixed interval analysis and 
fraotile analysis arc presented in this exposition. Two methods of comparing certain 
aspects of two bivariate distributions rather than their regression functions are des¬ 
cribed in Section I. It often happens that this is vory meaningful in certain 
practical situations. The large sample theory of some statistics that enter this 
discussion is presented in Sections 3. 4 and 6. Some historical notes about these 
methods arc related in Section C. A few tables that can he used for testing purposes 
when the underlying distributions are bivariate normal aro given in Section 7. 

I. TlIK MKTHODS OF FIXKD INTKKVAL ANALYSIS AND FRAOT1LK ANALYSIS 

One of the important problems of Statistics is the study of the relationship 
of one vnrinblo )' with another variable -V and of the comparison of such relationships 
among different populations. These are usually made through tho study of the 
regression function of Y on A', that is, through the study of tho function B( Y | X = j*). 
A common problem met with in practice is the comparison of tho regression functions 
in two populations (V\ X) and (1”, A"). We can give illustrations for this problem 
from practically every applied field of Statistics. We will however content ourselves 
with one example which wo will refer to, for purposes of illustration, in the sequel. 
Data on a pair of random variables {Y, X) and ( X') arc available. Y and X refer 

to tho consumption of milk (volume) and total expenditure per month, respectively, 
of an individual in a population P. )" and X’ refer to tho same variates in a different 
population P\ The problem is to compare tho patterns of relationship of tho consump¬ 
tion of milk with tho total expenditure in tho two populations. 

Tho problem just stated can be expressed in symbols as follows : Wo wish 
to test whether or not 

A(x) = A'(x) for all x ... (1) 

where 

A(*)= E(Y\X = x) ... (2) 

A'(*) = £(r!.r = x). ... (3) 

This is the sort of regression problem we shall be concerned with in this section. The 
classical method of approaching this problem consists in assuming that the regression 
functions A(x) and A'(ar) are of a certain algebraic form, say, a polynomial, a trigono¬ 
metric series or the like, completely determined except for a finite number of ‘para¬ 
meters.’ Tho problem of testing the equality of tho regression functions then reduces 

• This research was supported in part by tho Mathematics Division of the Air Force 
Scientific Kosoorch under grunt no. AK-AFOSR-62-169. 
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to the problem of testing the equality of these parameters. The difficulty in these 
methods is that the assumption of an algebraic model for the two regression functions 
is too great an over simplification of the actual situations. Further, it is very difficult 
to test whether any particular model fits in a given practical set up. Another diffi¬ 
culty arises from the fact that X and A" could be discrete and \{x) and A'(x) be uniquely 
defined on different sets o*“ the x's. Again if X and X ' were ages of individuals and 
} and } their weights, then an observation on the ages like 12 would actually mean 
that the age lies bet ween 11.5 to 12.5 and the comparison through point-wise regression 
functions would be too farfetched. In such situations the appropriate hypothesis 
would be to equate the regression of the Y's on suitably chosen intervals of the X's. 
l’he methods of fixed interval analysis and fractile analysis, to be described here, con¬ 
sist in comparing the regressions interval-wise rather than point-wise, and it is the 
choice of the intervals that distinguishes the two methods. 

In fixed interval analysis we fix to start with <j fixed intervals 


(«o. a »J* («i. «*]. .... a # ] - H) 

by means of the ({ 7 + 1 ) constants 

«o. «i. “g ••• ( 5 ) 

satisfying —co = a 0 < a x < ... < a,_ x < a, = + co. ... (0) 

We then define the regression v(a, b) of Y on X in an interval («, b J by the relation 

v(a, b) = E(Y\a < X < 6). ... (7) 

Let v(a<_„ a ( ) = v„ » = 1. g. ... (8) 

The quantities v< are defined in the same way for the random variable ( Y’, A'). In 
fixed interval analysis we test the hypothesis that 

v = v' ... (9) 

where v — (v lt v,), v'= (v',.v'„). ... (10) 

It is obvious that such a hypothesis becomes meaningful only when the intervals 
(a n , «,]. ..., (v i- n o\ of < 4 ) ttre choscn carefully. For instance, in our illustrative 
example, let the populations P and P ' correspond to two constituent states of 
the Indian Union at the same point in time. Several comparable social strata can bo 
defined in the two populations by a suitable choice of the intervals of (4). Such 
strata might correspond to expenditures classified as ‘lower class’, ’lower middle 
class’, etc. In this case the hypothesis (9) is meaningful and fixed interval analysis 
is appropriate to the situation. 

It should be noted that the use of a large number of strata would mean that 
the hypothesis v = v' is practically equivalent to the hypothesis M*) = A'(.r). 

The practical details of the method are as follows. We estimate the quantities 
v and v' suitably and test for their difference. 

(y„ *i) .(y- *n) 

(y!,*i), — 


Let 

and 


( 11 ) 

( 12 ) 
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be two independent samples S and S' from the populations P and P' respectively. 
Let w, he the number of observations of the samples S with ^-components in the interval 
(°i- 1. «;]• » — I.J7- 

Let v, = £ »/,/*,. * — 1..... £7 ••• (13) 

"i-« < 'r < '*< 

where the summation is made over all ;/ r *s for which r/s lie in «,1. We calculate 
v,, i = J, .... g in a similar way from the sample S'. The vectors 7> and f>* called the 
fixed interval means arc estimates of v and v\ We define several measures of 
divergence between the sample estimates for the two regressions : 


o=i I| 




... (15) 


r = (»-»') B(v-vy ... (io) 

where B is some positive definite matrix. Large values of these statistics will form 
the corresponding rejection region for testing the hypothesis in (0). It is an important 
problem to determine the distributions of these statistics, at least in large samples, 
and sot up significance points. Sections 3 And 4 deal with this problem. 

We now proceed to remark that there are many problems where fixed interval 
analysis becomes conceptually meaningless or partially so. As an example let us 
suppose that in our practical example, the populations P and P' correspond to two 
different states having different currencies. After setting up interval limits to the 
total expenditure reflecting different social groups in one population, we may find 
it very difficult to demarcate comparable limits in the currency of the second population. 
The official exchange rate cannot be used hero since it does not reflect the actual pur¬ 
chasing power of the two currencies. The real oxehango rate that does this is not 
easily available. We have thus presented a typical case of the general situation where 
A' and A" are not comparable and where fixed interval analysis is not useful. 

In the above example we can safely assume that the total expenditure is a 
monotonic function of the socio-economic level of an individual. Thus, though the 
total expenditures in the two countries are not directly comparable they are mono- 
tonically related. Groupings based on the ranks of X and X' will be comparable in 
a meaningful way. Professor P. C. Mahalanobis made use of this fact in proposing 
a new method called fractile analysis for such situations. 

We describe this method after developing some notation. Let 0 U« () 

1 2 g~ I *’ 2 ” ’ 1,-1 

be the g -th, “ -th, ... ^ -th quantiles (or fractiles) of the distribution of X. 

Let 0 0 = -co, O g = -f co. Let 0' 0 . 0 \,..., 0' 9 be the corresponding quantiles for the 

distributions of X'. 


Let 


v, = 0 f) 1=1. g 

v .' = v'(0J-i, 0\) i = 1 , g . 
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We see that the intervals (0 O , O x ), (0„ 0 2 ), .... (0 9 _ x , 0 „) of X represent the lowest 
lOO/j? percent section, the second lowest 100/0 percent section, ... the highest 100 /g 
percent section, respectively, of population P. A similar interpretation can be given 

for the intervals {0’ 0 . 0\), (0|. 0j).(0'_„ 0') of X' in the second population P\ 

Thus these intervals are comparable in a very important sense, although the X values 
are different. The method of fractile analysis consists in testing the hypothesis 

v = v' ... (19) 

"here v = (v,.v,), v'= (vj, .... v;). ... (20) 

The practical method adopted is as follows. Let S and S' he the samples from 
the populations P and P' respectively, as in (11), (12). Rearrange the observations in 
the sample S so that the x'h are in the increasing order of magnitude thus 

(?m». *u» (y««». *(*>). —. (y«-». *<•>) ••• 

with *<„ < *<„ < ... < ••• ( 22 ) 

Let n = m.y where m and g are integers. Let 

Vi= £ y<<rn/ m > « = 1,....0. ••• ( 23 ) 

«-!)*•< rc im 

v\, i = 1. g are defined in a similar way from S'. The vectors v and v' called the 

fractile means, are estimates of v and v'. Suitable measures of divergence arc then 
defined. Mahalanobis defined one such measure called separation, as follows. 

Plot the ordinates v lt v 2 . v g corresponding to the equidistant points 1, 2. <j. 

Join the successive points by straight lines; the curve G thus obtained is 
called the fractile graph of S. The fractile graph O' of S' is obtained in a similar way 
and drawn on the same paper and to the same scale. The area A between these two 
graphs, and the ordinates at 1 and g called the separation, is a measure of divergence 
between the two sample regressions. The algebraic expression for A is 

A = *£ ^ | -4--^-1 —* , <-*-* I 


\ I to—»«)to»i—W+ i)_Ll 

-0to-t>„ »<♦« *«♦*> 


where 


d(a 


if ab > 0 
if ab < 0. 

Some other measures of divergence which have l*en considered 


■ b)= l 


... (24) 

... ( 25 ) 


n rf* 


D = £ K- *\l» 

... (26) 

i~i 

A = £ fa-v]) 1 

... (27) 


r = (»-»') B(v-vy, 

... (28) 
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where B is some |*>sitive definite matrix. Largo values of these statistics form 
corresponding critical regions for testing the hypot hesis in (19). We repeat t he remark 
made earlier, that at least the large sample distributions of those statistics should - 
determined before using these measures for testing purposo. Till now only descriptive’ 
methods aro available for the methods of fixed interval analysis and fraetile analysis: 
for examples, see Mahalanobis (1958), (I960). We find the requisite limiting distribu¬ 
tions in Section 3 and theso can now be used in practice. 

Let us add a few points bringing out the special character of the method ol 
fraetile analysis in comparison with the method of fixed interval analysis. For 
applying the method of fixed interval analysis the random variables X and X' must 
be directly comparable and some intervals resembling strata should be formed. Wo 
then compare the regression in these intervals. Tho method of fraetile analysis is appli¬ 
cable to tho more difficult situation where X and X' aro not directly comparable but 
are monotonically related to a common character that X and X' are supposed to 
measure. This, then, is the general sot up whero fraetile analysis can bo used. Such 
situations have been encountered in Econometrics, Psychometry, Demography, etc., 
and fraetile analysis has been applied, though, ns yet only in a descriptive way. (See 
Mahalanobis (1000); Das (I960); Das and Sharma (I960); Sora (I960)). Fraetile analysis 
is now being utilised in the National Sainplo Survey of India on a largo scale. 

Several modifications of the method of fraetile analysis can he made. After 
ranking the individuals we can take groups with varying proportions instead of equal 
proportions. Thus a group already formed may he split up into several subgroups 
for a more detailed analysis of tho regression in that group. This has been oinployed 
in Mahalanobis (I960). For calculating the sample estimate of v. the median, mode 
or some other suitable characteristic can be taken instead of tho mean. These may 
be easier to compute in practice. This has been stated in Mahalanobis (1958a). 
There is a lot of flexibility and many similar modifications can bo made. 

In practice, it frequently happens that we tako several and independent 

sub-samples S,. S k from a population P instead of just one sample. These arc 

called interpenetrating sub-samples and their usefulness in a large number of situa¬ 
tions has been recognised. (See Mahalanobis. 1946). If interpenetrating sub-samples 
aro taken from both the populations P and P' we can get measures, D, D x and D 2 , 
of divergence, from tho samples measuring tho divergence between the combined 
samples of P and /'', within the sub-samples of P and within tho sub-samples of P ', 
respectively. Thus D would bo tho between divergence whereas D x and D 2 would 
bo tho within divergences. These terminologies are analogous to thoso in analysis of 
variance problems and aro self-explanatory. Suggestive as they are they permit us 
to develop some tests of at least a descriptive nature. (See Mahalanobis, 1958a: I 960 ). 

Finally, we add that the quantities calculated in the methods of fixed interval 
analysis and fraetile analysis can suitably be modified to estimate relative concentra¬ 
tion curves and relative concentration ratios. The utility of theso is well known and 
have been used by Mahalanobis (1960), Roy, Chakravarti and Laha (1959), Iyongar 
(1960) etc. 
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We now give a brief description of the method of obtaining the concentration 
curve etc. The following symbols will be used : 


V t — Wi® 1 +w 1 » J +...+n < »| ; 1=1. g , 

... (29) 

II 

© 

II 

... (30) 

g; =p,./p; * = 0, 1. g 

... (31) 

P'i = (»i+w*+...+w i )/n; *=l, ...,g. 

... (32) 

Po = 0 

... (33) 

— (*!+•• * = i, 

... (34) 

V 0 = 0, V § = V, 

... (35) 

= V/V,; » = 0, 1 ,...,g, 

... (36) 

p' = '!g\ * = o, g. 

... (37) 


When the method of fixed interval analysis is used an estimate of the relative 
concentration curve of Y on X is obtained by plotting the points 


(?«). (pI. ?i).... (p: r%) 


(38) 


and joining successive points by straight lines. The relative concentration ratio is 
estimated by 

G = -i- [S.1,6, <«_,+«)]-1. - (30) 


When the method of fractile analysis is used an estimate of the relative con¬ 
centration curve of Y on X is obtained by plotting the points 

(Piq'o). (p\. <i\) .<*>;.</;) - < 40 > 

and joining successive points by straight lines. The relative concentration ratio is 
estimated by 


C 


2 

gV 






g±i 

9 


(41) 


2. Notations, definitions etc. 

In this section we develop the notations to be used in Sections 3, 4 and 5. Since 
we are developing the theories of fixed interval analysis and fractile analysis side by 
side and since they are similar to one another in many respects, the notations employed 
will also be similar. Whenever possible we will distinguish the quantities involved 
in fixed interval analysis by a bar . 

Let ( Y, X) be a random variable on the Euclidean plane with distribution 
function 6'(y, x). The distribution function of A" will be denoted by F(x). 
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Let (y„ Xj), (y 2 , x t ) .(y*. *„) ... (-*2) 

be a sample »S' of n independent observations on ( Y, X). Let us arrange the observa¬ 
tions according to the increasing order of magnitude of the x'a, thus : 

(jlini)i -* 111 ). (i/uin. *i*».(ift(N)i* ••• 

The lixed interval method of analysis involves stratifying the population 
into y strata. Let these strata be formed by the predetermined constants u 0 , a v ..., a 9 
satisfying 

—co = a 0 < <i, < ... < a # _, < a t = +co. (44) 

These constants introduce y strata in the domain of (Y, X) as follows : the r-tli stratum 
(r «» I, ... ,y ) contains all (y, x) with ci,_, < x < a,. We define 

it, = /’(a,)-F(a r _ l ); i = I. g ... (45) 

and throughout the discussion on fixod interval analysis wo shall assume that 

(i) the variances of Y and X are finite *) 

>■ . ... (40) 

(ii) ”, > 0. r s» I. y. J 

Let us define tho means, variance and covariances of Y and X in these y strata 

/•, - E(X\a r _ t < A < a,)\ v, - E(Y\a r . x < X < a,) 

= V(X\a r _ x < X < a,); f* - V{Y\a f _ t < X < a,) ... (47) 

p,d t T r ~ cov (Y, A |a f-l < A < a r ); r * 1,.... g. 

Let n„ n t , .... n $ be the nurnbor of observations in tho samplo S in tho 1-st, 
2-nd, .... 0 -th stratum, respectively, introduced by tho constants in (44). Wo shall 
denote tho proportion of observations in theso strata by p t , p t . p g , i.o. 

p t =*njn; i = 1,...» g. ... (48) 

Tho moans, variances and covariances of tho sample 5 in those strata are definod as 
follows : 

“i — 2 x rb'o = 2 

«i-» < X, < a. <H-1 < X, < a, 

= X (x r -MjVn*; =» 2 (y,-v { )*lm ... (49) 

< *r < <*< «i-i <*,<«< 

W’< = 2 (^r—«iKy,—* = i, ...,y. 

a i-, < *> < oj 

In tho theoroins of tho noxt section wo will bo interested in tho limiting distribution of 
the following statistics. 

ii(n) = y/7i( Si—ii); rjM = y^-v,); 

£.(«) = V»(Pi—”iY, i = 1,.... g 

ii”) =(Ci(n), .... l^n)); ij(n) = ( 7 x (n), ..., 7 „(n)) ; 

?(n) = (Ci(n), .... £(*)). 


... (50) 

... (51) 
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In problems connected with tractile analysis we shall assume the following: 

The distribution function G(y, x) admits of a density function g(y, x) 
u hicfi is continuous and which does not vanish. The density function of F{x) !-••• (52) 
will be denoted by f(x). Further the variance of Y arul X are finite. 


E(Y\X = x) = A(*); 

A(0<) — A*, i = 1,..., <7—1; 
A 0 = 0, A, = 0. 


(53) 

(54) 


In the fractilo method of analysis the population is to bo divided into a pre¬ 
viously assigned number, g of starata thus. Let 0, be defined by 

i/f; i = 

0 q = —CO, 0, = +oo. 

Then tho r-fch stratum is defined as the region of all points ( y . a-) with 

0,.i < x < d f , r = 1. g. 

The means, variances and covariances in these strata are defined by 

. Mr = B(X\0^ t < X < 0 f ); v, = E{Y\e r . l < x < o,y, 
or* = V(X\0 r _ x < X < 0,); r* = V(Y\0 r _, < X < 0 f ); 
p r fT r T r = cov (Y, X|0 r _,< X < 0 f ); r = 1, .... g. 

We also require tho regression function 


(55) 


(56) 

(57) 
( 68 ) 


The corresponding quantities are defined from the sample S. It is assumed 
that n = m.g where m is an integer. 


tq = £ 




£ VurJm ; 

<r*im 


(59) 




s if 

(•-Dm < i‘m 


£ (y«r»-*»<)*/"»; 

«-!)»< 


£ (x< rt -*iXV((r»-Vi)/m; »=1.«7- 

(r-|)m<rSi« 


In tho next section we will be interested in the limiting distribution of the 
following statistics. 


£i(n) = 

j/*(») = \Zm(v l —'e i y, i = 1, —. 

... (60) 

£ 4 (n) = v'**( ar «-+»»“^ ; * = 1 . 

... (01) 

£(n) = <*i(*). —» t,(n) = (,7,(n) ’ 17#(n),; 

... (62) 

S(n) = <&<*), Cr-i(»))- 
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In the following sections we shall have occasion to consider another random 
variable (Y\ X') constituting a population P'. The constants for this population 
will be obtained by adding a ' mark to those of P. In the same way the statistics 
from a sample with somo suffix will be obtained by adding that suffix to the statistics 
of the sample S. 


3. Limit distributions 

In this section we state without proof some results concerning tho limiting 
distributions of the statistics entering (51) and (62). The proofs of all these theorems 
can be found in Sethuraman (1901a). The results concerning the statistics entering 
fixed interval analysis and fractilo analysis can also be found in Sethuraman (1903) 
and (1901). 


Theorem 1 : Let condition (45) hold. As n —» oo, the sequence of random 

variables rj(ti). £(«)) converges to a random variable (£,. rj. ^) with a multivariate 

normal distribution with mean vector 0 and variance covariance matrix 


Where 


K = 


£ 

n-n 

e n-> 

1 

o 

E 

n-» 

T n-> 

0 


i 

0 

0 

A' / 


£ » diag*(«Tj.**), 

f — ding (ff. .... f*), 

E = diag ( p x cr x r x . &, r,). 


n = diag (rr„ .... n f ), 

— n i n i 

-ir x ir 2 , n 2 (l-w,) 


— ”z” e 


(03) 

(04) 

(05) 

( 66 ) 

(67) 

( 68 ) 


-n x n t . 

Corollary 1 : The distribution of rj is multivariate normal with mean vector 
0 and variance-covariance matrix A where 


A = t n-». 


(69) 


«0«g ( 61 . . •., t/i) ulond* for the diagonal matrix 



68 
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Iheorem 2 : Let condition (52) hold. As m-> co (i.e. n—► co) the sequence of 
random variables (£(»), T)(n), $(n)) converges weakly to a random variable (£, yj, £) with 
a multivariate normal distribution. 

Let 

M { = t(0,—(i— IK#*-*—/*<); * = 2, g —1, 

J/ i = (01-/0, Af, = — (0 — 1 )(0 a -i —/O ... (70) 

J/ < = (0-*X0<-7*.)-(?-»+W<-1— Mi); i = 2, ..., <7-1, 

J/o = (J7-1X01-/*!). M, — (0 # -i-/*,) ... ' (71) 

** ■ «(A < —v,)—(*— 1 XA<-i— v,); » — 2, ...,(7—1, 

^-(Aj-v,), iV, = —(l7—l)(A # _t — v a ) ... (72) 

W - (l/—*'XA(—v ( )—(^—*+l)(Af_i—v,); » = 2,.... <7-1, 

iV? = (</-l)(A l -v I ), (A # _,-v # ). ... (73) 

Lot 2J, = 1 A/^/J j > i 

= j MjM<t i>j 

= <r?+ ! Jf,a/f+(0,— /* < X0<-1— /*<) * =i. * 9* 1,<7 ... (74) 

- <r?+—3/^/? »-i- 1 

0 

= <ri+yM,M2 i-j = 9- 

An = * j > i 

= ‘iV^iV? • > j 

= rf + ^ A' i A’?+<A ( -v ( )(A i _ 1 -v ( ) f =i; t # 1, SF - ( 75 > 

= t?+*A\A'? < = J = 1 

= T j+‘iV,,v; .-=i = s 
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4 ;VJ 

si-ijfw j>i 

= yA'.WJ j < i 

= WiTf+l-Miin+lO,-/ i,XA,. l -v < ) J ... PO) 

y 

-/w»+ * • -i— i 

Corollary 2 : (£, tj) Am a multivariate normal distribution with mean vector 
0 and variance-covariance matrix 



Corollary 3 : tj has a multivariate normal distribution with mean vector 0 
and variance-covariance matrix A. 

Theorem 3 : Let S ltt . S tkl be k independent samples, each of size n, on 

(Y, X). Let S be the pooled sample. Let (£< n (n). r\ iV (n)) . ($,*,(w). rj,*,(«)) and 

(£(n), yj(w)) be statistics computed from these samples. 

Let 

a°<»>. i°<»» = a,«.(»). i«.(»)). ... (78) 

Let condition (52) hold. Then ($(n), *)(>»))—(£°(n), n°(n))-* 0 in probability. 

4. Thkoretical applications 

In this section wo show that the limiting distributions of Section 3 in effect 
reduce a largo sample 5 from a population P to just one observation (bor v) from a 
multivariate normal distribution. We then derive the limiting distribution of the 

measures of divergence D, A, I\ A, D, A and r(see Section 2) used in fixed interval 
analysis and in fractile analysis. We indicate the tests that can be used when several 
(interpenetrating) samples aro available from each population. The asymptotic 
distributions of the concentration ratios (39) and (41) are shown to be normal. 

Let samples S and S' be drawn from the populations P and P' respectively, 
and the method of fixed interval analysis be employed. Corollary 1 states that v' is 
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asymptotically normal with mean and variance-covariance matrix A/n. We write 
this in symbols as follows 

v^MN(y,A/n). ... (79) 

Similarly 

v' ~~ MN{y\ A/n). ... (80) 

(70) and (80) show that the samples S and S' are now reduced to the vectors v and v' 
respectively, with asymptotic multivariate normal distributions. 

Lot 7i, n'—* oo in such a way that n/n'-+ c, 0 < c < co. Then 

v — v' ~~ MN{y— v', (A-f cA')/n). ... (81) 

From (81) we can easily obtain the asymptotic distributions of D, A and V under the 

null hypothesis (9). nA has a limiting distribution which is the distribution of 
where X\ .X# arc independent x 2 **ith 1 d. an< * 



For a particular choice of B. nT is equal to n £ [(€><— €><)*/ ( ^ +c -J. ) 1 and has a limit¬ 
ing distribution that is a x 2 with g degrees of freedom. The limiting distribution of 
y/nD exists but does not have a simple algebraic form. 

Let 5,,,..... S tk , »>e k independent and equally valid (interpenetrating) sub¬ 
samples of the same size n from the population P. Let 5J„,... £><*'» bo k' inter¬ 
penetrating sub-samples of size n' each from P '. If n and »' are large these two 
sets of samples can be reduced to two samples r,,„ ..., »«*, and r ( „. ... »>,*', from multi¬ 
variate normal distributions with parameters* (v,A/n) and (v'. A' In') respectively. 

The problem of fixed interval analysis is to test the hypothesis v = v'. Since 
A and A' are diagonal the problem can be viewed as the problem of simultaneous 
independent Fisher-Behren tests. 

To pose the problem as one in classical multivariate analysis we should 
strengthen hypothesis (9) to the hypothesis 



* The parameters are the moan 


and the variancc-covarianco matrix, respectively. 
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Mult ivariate analysis now yields us two solution, to this problem. Wo can ..so the likcl. 
hood ratio criterion 


ft {kciil+k'i'+kk'civ,-v, )*]/(Aci*+ *]} 

r-l 


(83) 


v. 


i t 

i-1 


where i; = S (t> rlj , — »,)*/*• 

j-i 

Large values of this criterion will form the region of rejection. The distribution of 
this criterion has been evaluated by Box (1949). Another method is to use tho cri¬ 
terion 

... (85) 

, i/i , l (cA **+VTW + Ac)]* 

The distribution of this criterion is the distribution of the absolute maximum of g 
independent b distributions each with &+*'-2 degrees of freedom. Significance 
points of this distribution can easily be obtained from the tables of tho ^-distribution. 

Let samples S and S' be drawn from the populations P and P' respectively, 
and tho mothod of fractilo analysis bo used. Corollary 3 states that 

v ~~ MN(v, A/m) ••• ( 8 °) 

t>* ~ ,ViV(v\ A'/mO — < 87 ) 

which show that tho samples 5 and 5' are now reduced to the vectors t> and t>' respec¬ 
tively, with asymptotic multivariate normal distributions. 

Let w, n'-400 in such a way that 0 < c < co. 


Then r— v' ~ MNiy— v', (A + rA')/m). ... (88) 

From (88) we can obtain the asymptotic distribution of A, D, A and T under 
tho null hypothesis (19). wA has a limiting distribution which is the distribution of 

2 /? r y* where y?.y* are independent-#* with 1 d.f. and /?,. are tho latent roots 

of (A + cA'). T has a similar limiting distribution. By a particular choice of B, 

T - «i(t>-t>'KA+cA , )“*(t>-t>')' ... (89) 

and has a limiting distribution that is a y* with g d.f. The limiting distribution of 
y/m A and \/m D exist but do not have simple algebraic expressions. Crude approxi¬ 
mations to tho limiting distribution of \/ni A can be made by the use of the following 
easily proved inequality 

(90) 


^ < A < vWA. 
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Let S ll} . S (k) (5J„, .... «S' (t ',) be k(k') interpenetrating sub-samples from 

P(P ). If w(n') is large then v llit (v' (1) , ..., »J 4 »,) is a sample from a multivariate 

normal distribution with parameters (v, A/m)((v\ A'/m')). 

The problem of fractile analysis is to test the hypothesis v = v'. To tackle 
this problem as one in multivariate analysis wo use a restricted hypothesis 

v = v\ A = A'. ... (91) 

We now have the familiar problem of testing the equality of the mean when 
the variance-covariance matrix of one multivariate normal population is a constant 
multiple of that of the other. The Mahalanobis Z>*-statistic will bo used. Let 

v? = S v i(m) /k, 

•-i 

•n - £ *,<.,-«?>/*. ... ( 02 ) 

a-1 

S — (s 0 ). 


7, - [kes+ts'ye. ... (93) 

Then *±*1^1. _ E “ iT („o-r«-)(5)->(»•-»»') ... (94) 

is our test criterion. Its distribution is an F-distribution with g and k+k‘—g— 1 d.f. 


Let v(v') bo derived from S(S'), the sample obtained by pooling S (l .. S ik) 

..., S[ k ' t ). As an application of Theorem 3 wo can substitute v and v' and v° 
and v 0 ' in (94) without changing the limiting distribution. 

In the preceding discussion we assumed that the interpenetrating samples 
from each population are of the same size. We can remove this restriction by simple 
modifications. The tests mentioned above required several samples from each popu¬ 
lation, and make use of them only through the tTs or t>’s. This involves considerable 
labour and waste of information. When only one sample is available from each popu¬ 
lation we cannot make use of the measure of divergence A. D, etc., for testing since 
their limiting distributions involve unknown constants. In Section 5 we suggest 
methods of overcoming this difficulty. 


In Section 1 we described how concentration curves can be drawn with the help 
Of the data of fixed interval analysis and fractile analysis. We now give the l.m.tmg 
distributions of the concentration ratio, as a direct application of the theorems of 
Section 3 and a theorem of CramcSr (1946, p. 366). 
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y = - *i V .(*f r l+ S l) _ 

7 " (Z"i'<) 


-_Z 

(£fr,v,) (Ew,V r ) 


_X_ = d t ; » = 1,.... «/; 


'-y,^i-i+S ", v r 


(£»,-v.) .... 

Then y/ii(C—y) has a limiting distribution that is normal with mean 0 and variance 


... (»5) 

... ( 00 ) 
... (07) 

... (08) 



X d?r*+ eKe'. 

1 

... (00) 

Let 

_ 2EiV| g+1 

0( v i+—+v # ) g 

... (100) 


2 * y , . 

9K + ...+V,) (» 1 + ...+v,)“ a ‘' ' . "■ 

... (101) 


The y/m ( C—y) has a limiting distribution that is normal with mean 0 and variance 

dAd'. ... ( 102 ) 

Though we have not explicitly mentioned, it should bo noted that (40) is assumed 
when fixed interval analysis is employed and (52) is assumed when fractilo analysis is 
employed, in this section. 

5. Methods of testing with just one sample 

Among the statistics D t A and V that can be used to test tho null hypothesis 
(9) of fixed interval analysis, f is most suited for practical use sinco its limiting distri¬ 
bution is most simple. Further V corresponds to tho statistic that is used for testing 
simultaneously that several means aro zero when all the variances are known. When 
tho variables concerned arc independently normally distributed this test corresponds 
to the Hotelling’s T . Wo shall therefore use T in this situation. 

r... (103 ) 

Wo note that L an d k‘ are consistent for A and -31 , i = 1 .,. he UIlknown 


constants that enter in f\ 
Let 


r. = s[<^ lOT (3 + J?)]. - Cio*, 

We note that f * can be calculated from S and 5' and that its limiting distribution is 
a x 2 with g degrees of freedom. The critical region for testing tho null hypothesis of 
fixed interval analysis will bo the region of largo values of f *. 
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Our applications so far of Theorem 1 depend in essence on the fact that in 
large samples we can treat v x , .... v g as independently normally distributed variables. 
This can be used in many other ways. For instance, if we have two samples S (l) 
and S (2) (pooled, they form S) from one population P and only one, S', from the second 
population P', our test criterion would be 


r* = s[(g t —<•;>*/( ]. 

1 ' w «H+ n l<» n i'> 


(105) 


The limiting distribution of this statistic is again x* with (/ d.f. We have seen in Section 
4 (e.g. in (86)) that 

v — JIN{v, A/m). ... (106) 

Comparing this relation with (79) we note an important difference between fixed 
interval analysis and fractile analysis. These relations show that o and v are asympto¬ 


tically normal with variance-covariance matrices A/n and A/m, respectively, A is 
always diagonal, but A is not diagonal in general. A is diagonal only when A* = = A<_, 

for all i. This does not hold in general, for instance when A(*) is strictly monotone. 
Thus whereas ...,v g can be considered to bo independent in largo samples, v t , ..., v 9 
are dependent even in the limit. 

Among the several measures of divergence introduced in Soction 1, A and T 
can be used since their limiting distributions under the null hypothesis are of a simple 
form. 

m A = 'Lm(v t — v\) 2 

has a limiting distribution which is the distribution of 2 /?,**, where *?, .... x} ar © inde¬ 
pendent chi-squares with 1 d.f. and fi l% .... P 9 arc the latent roots of A + c.V. This 
distribution can bo approximated by dZ (sec Satterthwnite (1946). For other 
approximations see Robbins and Pitman (1949)] where Z has a ^-distribution with 
a d.f.; d and a are given by the relations 

d = Z/PilZfr - (107) 

a = (SA)VSA?- - ( 108 ) 




(109) 


has a limiting distribution that is a x a 0 dT- 

These two statistics cannot be used in practice unless A and A' are known. 
In trying to estimate A from S it is natural to use (? as an estimate of A (i . It can be 
shown, for instance from the results of Hocffding (1953), that (? is not oven consistent 

for A , in general. This unfortunate fact that no simple consistent estimate of A is 

available from S, is a great set-back to the construction of nonparametr.c tests in the 


mothod of fractile analysis. 

We therefore proceed to construct convenient test procedures when (F, Z) 
is known to follow some special distribution. Let us assume that the distribution 
of (Y X) is bivariate normal with parameters v,/i; Wo now evaluate the 

matrix A for this distribution. We note that A does not depend on v,/« and <r . 
Using (76) we find that A can be written down in the form 

A = t 2 I+p z t 2 Q **’ ' 
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whero / is the identity matrix and Q is a yyy matrix depending only on y. It can ho 
easily demonstrated that the matrix Q is doubly symmetric, that is 

— Qj.i — Qt-i+ 1.0-j+l = Qg-J+l.g-l+l • ... (1 I I) 

The matrix Q has certain interesting properties (not basic to our main work) which arc 
easily derived from the fact that * 2 i>, = y, the mean of y'n. Tims, Q is negative 
semi-definite, 2 Q tj = 0 for each i, one of the latent roots of Q is zero and so on. 

In '1 able 1, at tho end of this section, wo havo givon theso matrices Q for 
9 = 2(1)10. Since tho matrix Q is doubly symmetric, wo givo only Q it for 
J < » < 9~j+ IS 1 < j < [ ] for each y. 

We have also tabulated tho latent roots (q x . q f ) of Q in Tablo 2 for 

g = 2(1)10. Actually Q, q { , p i etc., all depend on y, so that Q g , q 9 /i g , etc., would bo 
tho more appropriate notations for them. Wo however drop the suffix y whenever 
wo feel that it will not cause confusion. 

Let f* and bo consistent estimates of r* and respectively. A is now 

consistently estimated by A = «? can |„. obtained from Table I for somo 

values of y.) Then 

f.A + A)- , (e _ e .,. 

will be distributed as a with y d.f. 

Tho latent roots of A are givon by r*+p*^q x . T'+f^q, and these aro 

consistent estimates of the latent roots of A. Let us denote the consistent estimates 

of the latent roots of A=cA' (which is obtained in the same way) by //,. fi . Then 

tho limiting distribution of mA can bo approximated by the distribution of S/f.v* 
whero X?,..., X, ore independent chi-squares with 1 d.f. We should note that large 
values of tho statistics mA and f form the critical region for testing the null hypothesis 
(ID) of fractile analysis. ** 

* . ,, V '.' e "°" * Ug8 “‘ two n,ctl,od * of estimating r« and p*r* from the sample S. 

u »„d T T. , * “TSt **, ° S,J * nd ' hC 8ample coefficient between 

y x. Then / and rV are cons.stent estimates of r« and p*r* respectively. These 

can now be used as suggested in the preceding paragraph. Since the sample site of 

method thT ' C "" S """ ng '° cora P ute * 1,n<1 '• We now suggest another 

method that will be computationally easier. 

This method makes use of the sample 3 only through ujs snd Consider 


59 




(113) 


(114) 


(115) 
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We can easily demonstrate (by showing that the expectations converge and 
variances tend to zero) that m 7 2 , mi 1 and m rs t are consistent for 

g — r 2 -f 1 7 2 p 2 L, <Ll±(r 2 + 1 a 2 L and />r<r+ — /?<rrL ... (116) 

9 0 0 0 0 ° 

respectively, where 

L — trQ+/& 
trQ = 9 ». i +--+ 9# ( 9 
where //,,, = //, as defined in (47). 

In Tables 3 and 4 wo have given tr Q 9 and E /*}., for g = 2(1)10. Making 
use of these tables and (116) we can obtain consistent estimates for r 2 and p 2 r 2 
based on 7, 5 and r. 


... (117) 
... (118) 


6. Some historical notes and comments 

The method of fractilo analysis was first introduced by Professor P. C. Mahala- 
nobis in a series of lectures at the Indian Statistical Institute in April 1958 and at 
Berkeley, Chicago and at East Lansing during May and Juno 1958. Some further 
observations and conjectures were made in his lectures in Tokyo and Kiyushu in 
November and December 1958. A preliminary report with the results of some model 
sampling experiments appeared in Mahalanobis (1958). A more detailed article on 
fractilo analysis with applications appeared in Mahalanobis (I960). Takcuch, (190.), 
Kawada (1901), Kitagawa (.900, and Mitrafanova (.90.) have inve.t.gated the hm.tmg 
behaviour and the expectation of the error area or separat.on, Takeuch. (1081) and 
Kitagawa (1900, have established results similar to that of Corollary 3 under <Ufferent 
conditions. Mitrafanova (190.) has proved certain other conjectures of Mahalanobis. 
The author's articles (Sethuraman, .90. and 1903) contain all the results of Section 3. 

The method of fixed interval analysis has been known for long and ha,> been 
Sethuraman (1961). 

A few interesting and difficult problems remain open. It seems likely that 
the restrictions of condition ,03, tat.be ^-^ot 
where 9 -co presents a tough the interpenetrating samples is 

of the pooled sample us.ng Sample Survey of India. It is 

:ec b ir“ —- -——— 

the sampling has been done by a multistage des.gn. 
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The following are the Q matrices Q g for g = 2(1)10, (Q 0 ) if has been given 
only for j < i < g—j+l, I < j . since Q is doubly symmetric. [See (111)). 


TABLE I. 10* x (Q a )if 


19 - 2> 

—:* 1 s:i i 

3IS.1I 

(9 - 3 ) 
-42034 
28431 
14323 


-56802 



(9 0) 

-61670 
18477 
11702 

-78001 

16127 

-81804 


8617 

11875 

14769 

-83312 

6761 

9317 

11588 

14202 

6466 

7532 

9368 

11482 

4460 

6146 

7044 

3586 

2602 

4941 



(9 = 10) 
-62913 
17783 
11290 
8352 
6600 
5394 
4480 
3727 
3044 
2241 


-82902 


I3S9I 

-84531 

10976 

13193 

8971 

10782 

7451 

6199 

8955 



468 


J. SETHURAMAN 


TABLE 2. LATENT ROOTS {q t ,», ... q 9tt ) = q 9 OF THE Q MATRICES: j-2(l)10. 

10 l x q 9 

9 - 2 

(00000, -63662) 

/ 

f 9-3 

(00000. -85294. -57478) 

9-4 

(00000, -93249, -80483, -54946) 

9 - 5 

(00000, -96323, -77658, -90674. -53621) 

9 - 6 

(00000, -97716, -52822, -94976, -88817, -75820) 

9-1 

(00000, -96960, -52293, -98448. -93896, -87424. -74527) 

9 — 3 

(00000, -51920, -98876, -97989. -86339. -96315, -93020, -73501H 

9 — 3 

(00000. -51644, -99148, -85460, -98579. -97583. -95707, -92295, -72828) 

0 - io 

(00000. -51433. -08945. -84740. -99332. -98309. -97220. -95297. -91084, -72230) 


TABLE 3. TRACE tr <?. OF THE 
Q MATRICES; g - 2(1)10 



0.03662 

1.42770 

2.28678 


3.18277 

4.10152 

5.30550 


9 

10 


5.98026 

6.93310 

78.2212 


FIXED INTERVAL ANALYSIS AND FRACTILE ANALYSIS 


469 


Tho following gives * . FOR g = 2(1)10 


TABLE 4. 


9 


2 

0.636020 

3 

2.379689 

4 

3.442239 

5 

4.484782 

6 

5.616166 

7 

6.640582 

8 

7.600287 

9 

8.676615 

10 

9.590464 
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By s. S. SHRIKHANDE 1 
Banaras Hindu University 
and 

D. RAGHAVARAO* 

Bombay University 

Summary 

In tins paper we generalise the concept of resolvability and affine resolvability, 
first used by Bose (1942) in connection with Balanced Incomplete Block (BIB) dosigns 
to a-rcsolvability and affine a-resolvablity of incomplete block designs. Necessary 
and sufficient conditions for a-resolvablo designs to bo affine a-resolvablc are derived 
for some BIB designs and Partially Balanced Incomplete Block (PBIB) designs. Using 
the rational congruence of matrices, we obtain nocessary conditions for existence of 
affino a-resolvablo dosigns. 


1. Introduction and preliminary results 

Let e t reatments be arranged in b blocks of size k{< e) such that no treatment 
occurs more than once in a block and further every treatment occurs in exactly r 
blocks. Such an arrangement is called an incomplete block design. The incomplete 
block design is called a BIB design if every pair of treatments occurs in oxactly A 
blocks. If we can define an association scheme for the treatments as given by Bose 
and Mesncr (1909) and if the pair of treatments which are i-th associates occur together 

in exactly A. (i _ 1,2. to) blocks, then the incomplete block design is called a PBIB 

design with m associate classes. 


An incomplete block design with parameters a, b. r, k will be said to be a- 

resolvable, ,f the blocks can be grouped into < set* S,.S, each of fi blocks such 

that in each set every treatment is replicated climes. Wo then necessarily have 

va^kfi, b = lfi, r = te. 


• A " ,TT IV f ab 1 le i " COmplctC block desi g" "ill be caUed affine ^resolvable if 
any pair o. blocks of the same set intersect in 7 , treatments whereas any pair of blocks 
from different sets intersect in q t treatments. 


1 Now with Bombay University 
* Tho work of this author 
Fellowship. 


financially .upported by th. Government of Indin IWarob 
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We shall denote the identity matrix or order m by J m ; an m X n matrix with 
all elements 1 by E mn ; and anmxn matrix with all elements 0 by 0 m „. We denote 
by UP, *) the following matrix of order 1. 


E P,1 

^p.i 

Ep.l 

- £ p.l 

Op.t 

Op,i 

0p,i 

• 

-Ep.l 

Op.1 

. 

• 

• 

L op,i 

• • • 

• ... 

Op.1 

• 

-£p.l - 


Let N = (» y ) be the usual incidence matrix of an incomplete block design, 
where 7i fJ = 1 or 0 according as the »-th treatment occurs or does not occur in the 
7 -th block. In the case of a-resolvable designs we will assume, without loss of genera¬ 
lity, that the blocks are so numbered that the first p blocks belong to S v the next p 
blocks belong to S 2 and so on. The following lemma is then obvious : 

Lemma 1 : If N is the incidence matrix of an a-resolvable design, then 


N Up, t) = 0. 

We now prove 

Theorem 1 : A necessary and sufficient condition for an incomplete block 
design to be a-resolvable is that the t- 1 column vectors of UP, l) form a set of characteristic 
vectors corresponding to the zero root of N'N where N is the incidence matrix of the design 
when the blocks are suitably numbered. 


Proof: If the design is a-resolvable, then from Lemma 1, 

N UP, 0 = 0- 

Hence 0 » 0. 

which means that the column vectors of UP. 0 form a set of characteristic vectors 
corresponding to the zero root of S*. Conversely N'N UP. 0 = 0, imphes that 

{N UP. 0}' i N UP- 0} = °- Hencc thc rank of NLi<1 ' 0 18 zero ' ’ NL{ft ' " °' 

This completes the proof. 

Denoting the Kronecker product of two matrices A and B by AxB, we have 

the following theorem. # 

Theorem 2 : Necessary and sufficient conditions that a symmetric matrix A 

of order pt be of the form 

A = I t x{{d-e)I $ +(e-f)E 0 , d }+fE u xE 0 , p - (L3) 

that (i) Pt = d +U>-l)s+P(t-l)f is a characteristic root of A of multiplicity 
1 with the corresponding characteristic vector Ept,V, 
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(") Pi = d+(ft-\)e-fif is a characteristic re>ot of A of multiplicity t— 1 and 
the columns of lA.fi, t)form a complete set of characteristic vectors cor res j>o tiding to this root ; 
and 

(iii) p 2 = d—e is a characteristic root of A of multiplicity t(ft— 7). 

Proof: Ihc necessity part of the theorem is easily verified. To prove tho 
sufficiency, we note that if li is any real symmetric matrix with distinct roots 0 0 , 0 X , 

.... 0 m of respective multiplicities y 0 , y,.y M and if A', is u matrix of y, orthogonal 

column vectors each of unit length which are the characteristic vectors of D corres¬ 
ponding to 0 % (i = 0. 1.in), then 

b * 2 o.x.x: 

'-o 

and hence the matrix is uniquely determined by its characteristic roots and the corres¬ 
ponding sets of characteristic vectors. 

We shall denote by GD(m, n), T(n), and L t (s) respectively, a group divisible 
design for mn - t> treatments divided into m groups of n eaeh, a triangular design for 
n(n-l)/2 treatments and a design for ** treatments with association scheme as 
defined by Bose and Shimaraoto (1052). We note that the matrix A in (1.3) is the value 
of AW* for a GD design with r - d, A, - e. A, -/. m - t, n - ft. We summarise 

r v v f ° r T U8C thC chftracte ‘ istic roots (other than 0, = rk) with their multiplicities 
of Ni\ of these designs as also the determinants of the gramians and the Hilbert 
Mmkowaski invariant C p of these gramians for any odd prime p. The results for 
(JD(m, n) can be easily verified and those for T(n) and L t [s) are contained in Ogawa 
(1959) and Shrikhande and Jain (1962). 

(1) GD(»n, n). 

Q x = rk—v\ t , a t — m— 1. 

0 2 =- r— A lt a 5 - m(n-l), 

IQil - vn", C p (Q x ) = (v, n")'(— 1, /i)7'- + *>/*, 

IQ*I - C piQt) - (-1, »)*«-♦*»/*. 

( 2 ) T(n). 

0 X = r-f(n-4)A 1 -(n-3)A,.a l = n-l, 

0 2 = r—2A,+A,. aj = n(n —3)/2 
I — n(n-2)"->, C P (Q X ) = (-1, n-2);‘"-i»/» 

•(-l,n-l);( 2 , n(n- 2)—»)„( — !. n) p (n, n- 2 ), 

(“1. «(n-2)"~*) p 

\Q 2 \~~ 2(n-l)(n-2)"-», C p [Q t ) = ( n {n-2) n ~*, 2(n-I)(n-2)"-*) p ■ C p {Q.). 

(3) Hs). 

0 X = r+(«—i)A,—(*+1—»)A fc ^ 

d z = r — IMs. a, = (s— 1)( S — i'4-i) 

IQil - C P (Q X ) = (-1, sY«'+*>n 

\Q 2 \~ C p (Q 2 ) = (-1, 5)*‘' + i+*>/*. 


60 
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2. Block structure of certain ( s) designs 

The L { association scheme is defined as follows [Bose and Shimamoto (1952), 
Shrikhande and Jain (1962)]. There are s* treatments which can be arranged into 
i sets •$ 2 . •••» S\ each consisting of s blocks of size s, such that each set is a complete 
replication and further any two blocks of different sets have exactly one treatment in 
common. The first associates of any treatment are exactly those i(s— 1) treatments 
which occur in the i blocks containing that particular treatment. All the remaining 
treatments are the second associates of that particular treatment. For each set Sj 
we can form a set of s vectors each with s* components in the following manner : 
Identify the s 2 positions in a vector with the s* treatments. For each block of Sj 
form a vector containing 1 in exactly those positions which correspond to the s treat¬ 
ments in that block and 0 in the remaining positions. Let these vectors be denoted 
by * itl , x )ti , .... Xjj (j = 1, 2, .... »)• From Shrikhande and Jain (1962) it is known 
that the characteristic vectors of NN' corresponding to the root 0, = »•+(*—*)^i 
—(«—»+1)A 2 are exactly the *(«— 1) vectors x Jtl —x jiti X iiX —X lt9t .... x it y—x), 
(j == 1,2,..., i). We note that each of the i sets of s— 1 vectors can be put in the form 
L{s, s) by a suitable permutation of co-ordinate positions which depends only on the 
set and not on individual vectors of the set. If 0 X = 0, then by renumbering the treat¬ 
ments so that the 9 treatments of the first block of 8] are the first s treatments, tho s 
treatments of the second block of SJ are the second set of s treatments and so on, we 
have 

NN'Us, s) = 0 

which implies that N'L(s, s) = 0, 

or L'i*. *)* - 0. 

Thus each block of N contains exactly the same number of treatments from each of 
the s blocks of Sj . The particular case of this result when i = 2 was given by 
Raghavarao (1960). 


3. a-RESOLVABLE BIB DESIGNS 


Let N x be the incidence matrix of an a-rcsolvablo BIB design with parameters 
v> b = tfi, r = let, k and A, where b-v = 1—1. The characteristic roots of N' l N l 
are rk, 0, and r—A with respective multiplicities 1 , t— 1, and 1(0— 1). It is clear that 
E, p , is the characteristic vector corresponding to the root rk of N' l N l and the column 
vectors of H/t, t) form a complete set of characteristic vectors corresponding to the 
zero root of N[N V Hence from Theorem 2, we have 


where 


N' l N 1 = 

A, = k—r+A, 


and 

Since A 2 is an integer we 


A a = k*/v 

have the following theorem. 


... (3.1) 
... (3.2) 


(3.3) 


Theorem 3 : A necessary condition for a BIB design with paratnelers 
v, I, =t/l,r = toe, k. A, where b-v = t- 1, to be a-resolvable is that v be an integer. 
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Formula (3.1) implies that the a-resolvable BIB design with incidence matrix 
N * ^ affinc ^-resolvable when 6 —v = I—1. Conversely, if the a-rcsolvablc BIB 
design is affinc a-resolvable, thon it can be shown that b—v=t— 1. In fact wo prove 
tho following stronger result. 

Theorem 4 : If an a-resolvable incomplete block design has any two of the 
following properties, then it has the third : 

(i) affine a-resolvability, 

(ii) balance, 

(iii) b—v = <— 1 . 

Proof : We have already proved that (ii) and (iii) imply (i). 

Assurae (,) and (ii) - Let N i bo thc incidence matrix of an affinc a-resolvable 
BIB design. Because of affine a-rcsolvability, the dual of the design is a group divisible 
design with 


fit. 


r, r, - k, 


whore the t>, treatments are d.vided into ( groups of ft each. On account of a -resolv- 
ab,Ut v the column vectors of Lfft,,) is a set of characteristic vectors corresponding 
to the zero root of and ,s complete since the multiplicity of the zero root of 

xv l * v i ,s t— 1 . ricncc 

6-/+1 = rank (tf;AT,) =. rankf.V,) - v, or b-v = <-l. 
which proves (iii). 

and hastol II vccTors'of' JtsTe f * GD< " » 

STf2 t0 ? 7erorootHencefrom **SK 

!ompL e " C * m ‘ tnX ° f " BIB dcsi «" which P™'-cs (ii,. The p l f „ tl|us 


4. Nonexistence of affine a -resolvable bib designs 
In this section, we derive necessary conditions for exists™ 
able BIB designs with the help of the Hassc-Minkowaski invariant A brief ^ 
to tho important properties of the Legendre symbol the Hilbert nn * n8ltm6 

and the Hasse-Minkowaski invariant is given^byS Tf 

assume these results here. In this paper p shall stand for explicitly 

the square free parts of a and 4 are same, we denote this fact by ° n ' y ‘ “ 

Let N, be the incidence matrix of an affine .-resolvable BIB design and let 



Obviously A>; is a square matrix with rational elements, 
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Now 

rWi om-i 1 

Wi = 

L 0t- 1 . » -J 

... (4.1) 


| N[N\'\~v/r-Hr-A)'-*, 

... (4.2) 

and 

C p (N\N\') = C p (N X N\)C p {fil t _ x +0Et-\. tp-') p 



= (rkl, -1),(/?, -1 (r-A. 

.(r-A, eyrfc,/?)■„-* ... (4.3) 


Since iV; is non-singular, |AW| ~ 1 and C,(A , ;A';') - 1. 

Hence we have the following theorem. 

Theorem 5 : A necessary condition for existence of an affine u-resolvable BIB 
design is that 

vp-Hr-Xf - 1 ••• ( 4 - 4 ) 

should be a perfect square, and further if (4.4) is satisfied then 

(rkl. -1),(/?, -1 )“-•*•-««((, A, — 1 )J*“"/* 

•(r-A, u),(rt, 1. ... (4.S) 

Shrikhande (1953) has obtained tho particular case of the above theorem whon 

a = 1. 


6. a-RESOLVABLE PBIB DESIONS WITH TWO ASSOCIATE CLASSES 

Let N 2 be the incidence matrix of a PBIB design with two associate classes and 
with parameters *. ft - if. r, k t A |( and A a . From Connor and Clatworthy (1954) 
we know that 0 0 = rk is a simple root of N 2 N 2 . Let zero be a root of N 2 N 2 of multi- 
plicity /*. Then the remaining root 0 X is also rational of multiplicity a x , say. We 
now prove the following theorem. 

Theorem 6. Ain cc-ruotvabU PBIB design of the above type is affine a-reeolo- 
able if and only if b—t = a v 


Proof: Suppose 6-1 = Then 0, = rk. 0. and 0 are thetotinct charac¬ 
teristic roots of N 2 N, of respective multiplicities a 0 = 1,1-1. and a, - l(fl )■ 
thcr Eta i is the characteristic vector corresponding to the rootd 0 - rk and the column 

vectors of UP. 1) form a complete set of characteristic vectors correspond,ng to the 

aero root of N‘ t Nf Hence form Theorem 2, it follows that 

N- t N, = 7,x{(i-A;)/*+(A;—A;)£,.»)+A ! B , j xBs.s ... (5 » 

J* b ft •** 

an lrrnKio Pnnverselv if the design is affine a-resolvable 

ITof both With the same multiplicities, 


we obviously have b—t — * v 
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In the above proof, we incidentally proved the following theorem. 

Theorem 7 : A necessary condition for the PBIIi design of the above type where 
b—t = a l to be a-resolvable is that k*/v is an integer. 

The following corollaries can be easily deduced from Theorem 0. 

Corollary 6.1 : An a-resolvable semi-regular OD(m, n) is affine a-resolvable if 
and only if b—t = m(n — 1). 

The particular case of the above corollary when a = 1 was derived by Saraf 

(1961). 

Corollary 6.2 : An a-resolvable T(n) with r-H»-4)A,-(w-3)A t = 0 is affine 
a-resolvable if and only if b-t = n(n—3)12. 

Corollary 6.3 : An a-rtsolmble T(„) with r-2A,+A, = 0 is affine a-resolvable 
if and only if b—t = n— 1 . 

Corollary 6.4: An a-resolvable L { (s) with r+(j-/)A 1 -(*-t+ l)A a - 0 is 
affine a-resolvable if and only if b—t = (s— !)<*— 1 ). 

Corollary 6.5 : An a-resolvable L t (s) xoith r-i\ x +(i- 1)A* = 0 is affine 
a-resolvable if and only if b—t *= i(s— I). 


6. Nonexistence of afpinf. Ac-resolvable i*bib demons with two 

ASSOCIATE CLASSES 

Let us consider PBIB designs of the type introduced in the earlier section. 

Lpfc *>* . bc a complete set of rational, orthogonal characteristic vectors corres¬ 
ponding to tho zero root of Put 

Let Jf = [*,.«,.*,]■ 

C { - x h x, 

and Y ~ X 'lingfCj-*, .C-t). 

Put 


and 


«-r *■ r i 

r X n 

*r - 

L L'ifi, l) 0,_ t . ,, J 


( 6 . 1 ) 


( 0 . 2 ) 


matrix. Vhen*' ^ ^ " ,S ° notc ,h » t “ * rational 

o>. 


iv; = a'" [ h * 1 

L °.i . 0 ,- 1 ) J' - (6 ' 3) 

Nix, ~ r ' b “i r 7 » ■) 

Lo.,» diag(Cr*.C f ». C;*)J Lo„, s oj' ' (6 ' 4) 

where Q is the gramian of the eomple.e set of rational eharaeteristie vectors eorres 
ponding to the zero root of N t N' corres- 


Hence 
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From (6.4) we have 

Wl. 

... (6.6) 

and 

C p (NW) = C P (Q). 

... (6.6) 

Now 

f -NN'+YY’ O v |_ x I 

W = 

L Ot- x. * <-l A 

... (6.7) 

From Shrikhando, Raghavarao and Tharthare (1962), we have 



INN'+yy'i = e& % 

... (6.8) 

and 

C P (NN'+YY') = (0 O , -v0?) p (v, 0 X ) P 




... (6.9) 

From (6.7), (6.8) and (6.9), we get after simplification 



l*WI = e,e°'tp-'. 

... (6.10) 

and C p (N' 2 N' 2 ) 

(Vf. 'A-‘),(-i. Ar- 11 '* 


. (t. ri’<o 0 , -V0‘‘uv, oj/o,, ICIw-1. e£' a ' +m . 
From (6.6), (6.6), (6.10) and (6.11), we deduce the following theorem. 

... (6.11) 


Theorem 8 : A necessary condition for existence of an affine a-resolvable PBIB 
design satisfying the conditions of the earlier section is that 

VfV-MQI ••• < 6 - 12 > 

should be a perfect square and further if (6.12) is satisfied then 

(-i. v0 "'^ v ' 0 & 

•(vr ,+1 . ici),(-i.®.) a,,a,+3) %(0)= i - - (*■»> 

As special cases of the above theorem, wo can state the following corollaries : 
Corollary 8.1: A necessary condition for existence of an affine a-resolvable semi¬ 
regular OD(m, n) is that 

A i tffi- 1 n m <f> > t 3 — (®- 14 > 


should be a perfect square and further if (6.14) is satisfied then 

(-i, /W" ,,/2 (*. A)p Vo. itW- 1 ' «T +8, W- +1 . n " ) * 

where <f> 2 = r— A x and p 2 = m(n- 1). 

Condition (6.14) was obtained by Saraf when a = 1. 

Corollary 8.2 : A necessary condition for existence of an affine a-resolvable 
Tin) where r+(n— 4 JA,—(«—3)A, = 0 t« that 

</J<-> 7 i(n— 2 )"-> 0 o ^’ "• <6-16) 
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ehould be a P tr f«* square and further */( 6 . 10 ) is satisfied, then 

(-1 

■ (-■. wJ’ l " +ll 'V/ ,+l . «i»-2rw-i. 

• (->. n-l);<2. n(n-2)*-*),(_l, „ X n, n-2), 

■ (-1. »)»(», n(n- 2 )*-*), = 1 , 
where ft, = r-2A,+A, and ft, = n(n-3)/2. 

Corollary 8.3 : A necessary condition for existence of an affine 
T(n) where I--2A.+A, = 0 is that 

2tp‘-H.n-l X n-2r-'Ojf‘,\ 

should be a perfect square and further i/(6.I8) is satisfied, then 

• < 1. ^i)* ,<a ' +3I/J (»^‘ +I . 2(n—l)(n—2)"->), 

• (n(n— 2 )*- 1 , 2 (n-l)(n- 2 )’-‘),(-l, 

• <-l,»-l£(2, B(n-2r->W-l, n),(n, n- 2 ), 

• (-1. »),(». n(n- 2 )"->), = 1 , 
where ft, = r+(n-4)A I -(i»-3)A, and /J, - „_i. 

Corollary 8.4 : A necessary condition for existence of an affine 
L M where r+(a-.)A,-<«-,■+l)A, = o is that * 

‘fi'-W,/,' 

should be a perfect square and further ./( 6 . 20 ) is satisfied, then 

(- 1 , ftlV-'^t.ftn, uftVlftc.ft,), 

■ (^ , M , »“X—i. _ J 

u-Aere - r-,A 1+ (i_l)A, and ft, = (,-!)(,_,• +I) . 


... (6.17) 

ct-resolvabU 

... (6.18) 


... (8.10) 

a-rcsolvable 

... (6.20) 


w /or *-*» 

should be a perfect square and further if ( 6 . 22 ) is satisfied, then 

(-1 .W-*ft«-*(W.) (,.*>, 

• 0W!‘ + *. W* , » I +»)Z*(_ 1> 4 >*. +i „ W= 
fa = r-f-(a-*)A 1 -(«-»-f l)A t aruf = ,(,_!). 


... (6.21) 

a-resolvable 

... ( 6 . 22 ) 


(6.23) 



480 


S. S. SHRIKHANDE AND D. RAGHAVARAO 
As an illustration consider the semi-regular GD(s, s 2 ) with parameters 


v = s 3 , 6 = s 2 (s-fl), r = s(s-|-l), k = s 2 , ••• ( 6 - 24 ) 

Aj = s, A 2 = s+1, a = 1, p = s m = s, n = s 2 . 

The above design can be constructed from a complete set of hypergraeco latin cubes 
of the first order (cf. Raghavarao, 1959). An application of Corollary 8.1 shows that 
a necessary condition for existence of an affine resolvable solution of the design is that 

(-1. *)•<•+»/* = 1. ... < 6 - 26 ) 

Hence affine resolvable C«D(s, s 2 ) does not exist with parameters (6.24) when s — 1 
or 2 (mod 4) and the square free part of s contains a prime = 3(mod. 4). 

It is interesting to note that the new techniques developed in this paper do 
not throw any light on the existence of a set of (»'—2) mutually orthogonal latin 
squares (m.o.I.s.) of order s. For, consider the L,(s) design 

v = s 2 , b = is, r = i, k = s, A, = 1, A, = 0, t — i, 

p = s, «-l. - <«- 2 «> 

which can always bo constructed if a set. of (• — 2) m.o.I.s. of order s exists. But the 
two necessary conditions of Corollary 8.5 are always satisfied, since W is always 
a perfect square and (-1, *){*-*»-*¥• is always equal to 1. 
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A NOTE ON THE RELATION BETWEEN MAHALANOBIS 
DISTANCE AND WEIGHTED REGRESSION* 

By GERHARD TINTNER 
University of Pittsburgh, U.S.A. 

The Mahalanobis distance (Mahalanobis. 1930; 1936; Mahalanobis, Boso and 
Boy, 1930; Kendall, 1946; Rao, 1952; Wilks, 1962) is defined in the following way : 

Lot us consider two normal p dimensional populations. Let 6 bo tho vector of 
the differences of tho population means and 2 the population variance-covariance 
matrix. 

We have 


A* - 6 Z-* S/p. 

In samples, we replace the vector 6 by d, a vector of tho differences of sample 
means in the samples taken from the two populations. Lot V bo tho estimated varianco- 
covarianee matrix in tho sample. An empirical counterpart of (1) is thon 

D* = d'V->6/p. ... (2) 

It is well known that the distribution of Z>* is closely connected with the distri¬ 
bution of Hotelling’s T(1931); (Frisch. 1934; Koopmans, 1937; Bartlett. 1948; Tintnor 
1945; Geary, 1949; Wilks, 1962). 

In weighted regression wo assume the following model : Let p, (t = 1, 2, 
.... A r ) be a vector of systematic components and x, the corresponding vector of obser¬ 
vations at time /; both the elements of the vector//, and x, are deviations from their 
arithmetic means. Also, Ex, = //,. Wo assume tho existence of p independent linoar 
relations between the systematic parts, i.e. tho elements of the vector //, : 

*••*-0 V = L 2 , .../,. ... (3) 

Further, let £ be tho variance-covariance matrix of the errors, i.e. 

E( x t PiK z i PiY = 2. m 
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Assuming normality, the method of maximum Likelihood is identical with the 
method of least squares if wo want to estimate p and the vectors 
We have to minimize 


Q = z,Q t - (5) 

Qi - ... (6) 

where the vectors m t are estimates of p r 

Now (6) is clearly analogous to (1); in practice E will bo unknown, but may bo 
estimated (e.g. by the variato difference method). (Tintnor, 1040; 1944). 

Then wo have 


<?« - V-Hxt-mt) ... ( 7 ) 

where V is the estimated variance-covariance matrix of the errors, i.o. an estimate of (4). 

Denoting the vectors of estimated regression coefficients by k, (u ™ 1, 2, ..., p) 
(our estimates for the vectors k w ) wo orthogonalizo and normalize by tho condition 

KVk m - ... ( 8 ) 

where S vu is the Kronecker delta. 

Minimizing (7) with the respect to tho vector m, under conditions (8) wo obtain 

Qi - ... (9) 

Substituting this into the expression for Q (5) and imposing additional 
conditions 


(*>,)'(*«*i) — 0 ***> ... (10) 

we derive the following system of linear equations for tho vectors k 9 : 

(A-AK)*. = 0 ... (11) 

where A is the variance-covariance matrix of the observations i.e., 

A = <SAft,)/(tf-I) 


where x it is an element of x r 

In order to obtain nontrivial solutions for tho estimates of tho vectors k e 
the determinantal equation : 


| A—AF| = 0 


(12) 
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must bo fulfilled. This gives us a method of estimating p, the true number of indepen¬ 
dent linear relations between the vectors//, in the unknown population: (Tintnor, 1940). 
Donote the roots of ( 12 ) by 


We have a statistic: 


^ ^ ••• ^ 


... (13) 


A / = (/V-l)(A l +A t +...-fA f ). ... (14) 

Then for large samples A, is approximately distributed like y* with (N—p— 1-f-r) r 
degrees of freedom (Hsu, 1941; Geary, 1948). Another approximate test is due to 
Anderson (1948). 


(A t -Nr)!y/2Nr 


(15) 


is approximately normally distributed with mean zero and varianco one. 

Now an approximate estimate of p can be derived as follows: We tost succes¬ 
sively A 1( A t ... . If A h is not significant at a chosen lovol of significance, but A w+1 
is significant, wo havo R as an estimate of p. 


Substituting tho R smallest roots of tho determinant*! equation (12) A,, A 2 
"• A* >»to tho linear system ( 12 ) wo dcrivo successively estimates of the vectors k 
i.e. k lt k t ... k R . *’ 


In a recent paper (Tintnor. 1960) it has also been shown that our estimates 
are optimal in the sense of information theory as proposed by Kullback (1959)- they 
discriminate in this sense most successfully between the population of tho observa¬ 
tions and tho errors. 
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WHAT IS WRONG WITH THE TEACHING OF 

STATISTICS ? 


By F. YATES 

BotJuiins/nl Exprrimental Station 

These remark* have been stimulated partly by a report (1901) of a conference 
on the teaching of mathematics which was held at Southampton University, partly 
by proposals for courses in statistics recently made by several English Technical 
Colleges, partly by the difficulty of recruiting suitable graduates for practical work 
in research statistics, and partly by historical research occasioned by the writing 
of a Memoir for the Royal Society (Yates and Mather. 1003) on my old friend Sir 
Ronald Fisher. 


The Southampton Conference was concerned with the shortage of mathema¬ 
ticians and the fact that the consequent shortage of mathematical teachers is lending 
to fewer young people studying mathematics and a lower standard in the quality 
of the teaching. It was also concerned with the reorientation of the teaching so as 
to include new branches of theory, and to give an introduction to applications, such 
as statistics, of practical interest. 

Part of the object of this proposed reorientation was to give the subject a 
wider appeal, so that more mathematically able young people would be attracted to 
it. It may be doubted, however, whether the proposed changes in theory, however 
fashionable, will effect this. Much of set theory, for example, will seem like so 
much hair-splitting to the more practically minded youngsters, just ns number 
theory did in my day. Moreover practical applications, to be of interest, must be 
'live' and up-to-date. Most of the proposed course on statistics, which is discussed 
below, might have been drawn up about 1910. 


The idea common amongst pure mathematicians that a highly sophisticated 
logical approach is appropriate for the young reaches its extreme in an experimental 
course prepared by the School Mathematics Study Group of the U.S.A. ( 1959 ) f or 
7th and 8t, ‘ grades (ages 12-14). In this course ‘non-mctric’ geometry, for example 
is introduced by considering a line (=a straight line, infinite in both directions) ns 
a set of points. This leads immediately to hair-splitting and conventions in termino¬ 
logy of the most tiresome kind. Thus a finite line (including its end-points) is termed 
a segment , a line infinite in one direction a ray if with its end-point, a half-tint if with¬ 
out its end point.* A trianglo is defined as the union of segments AB , AC . BC (A B 


•Noto that two half-linos do not constitute tho wholo lino, 
•half’ than tho colloquial 'tho larger half’. 


This is a worse misuse of tho word 
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and C not being collinear) i.e. as all points belonging to one or more of the segments. 
Ihe student is then asked : “Are the angles of a triangle contained in a triangle ? 
. ou may wonder why we call < ABC an angle of A ABC when < ABC is not contained 
in AABC. But think about it. We speak of the graduates of a school even though 
graduates are not in a school.” Is this really an improvement on Euclid ? 

Personally I suspect that these logical refinements are unlikely to attract 
immature minds and will indeed repel the more practically inclined. Part of the ex¬ 
cessive emphasis that tends to be placed on rigour is attributable to the belief of pure 
mathematicians that, if only they have available a fully rigorous system, further 
truths can be established with certainty by any qualified mathematician. This is 
against all experience and indeed against now known theory. In the first place, as 
is well known, mathematicians are not infallible in applying their own rules of proce¬ 
dure. Apart from errors of manipulation, e.g. algebraic errors, they are also only too 
prone to logical errors. Mathematical literature abounds in examples of theorems 
for which proofs have been confidently advanced but which have later proved to bo 
false. An example familiar to statisticians concerns the non-existence of a 10x10 
Graeco-Latin square. I believe two ‘proofs’ of this had been published, and a further 
one was accoptod for publication, when Bose et al (1959. 1900) discovered such a 
square. 


There is. howevor. a more fundamental reason why mathematics can never 
bo an infallible source of further knowledge. It has now been established that if a 
system of axioms allows the deduction of any contradiction, i.e. if it allows proposi¬ 
tion P and also the proposition not-P to be deduced by the ordinary rigorous process¬ 
es from the same system of axioms, then that system of axioms contains latent all 
contradictions, in the simple sense that any proposition whatever can be deduced 
from them. 

Clearly, therefore, it is very important to be able to establish that a system 
of axioms is self-consistent, i.e. free from all contradictions. But this is impossible. 
Sir Ronald Fisher, in a lecture at Michigan State University in 1958. gave a simple 
demonstration of this fact which is worth repeating both for its wit and because it 
emphasises the point that our trust in a theorem depends greatly on the reputation of 
the person putting it forward (Fisher. 1958): 

That wasn’t, however, the worst that befell the theory of the axio- 
matic basis for mathematics. It pinpointed the need for some means of 
demonstrating that a system of axioms teas free from all contradictions, 
because if it wasn’t it could lead to anything. And then the blow fell, which 
was due, I believe, to Godcl, who put forward a very long, very elaborate, 
and extraordinarily ingenious proof to the effect that you could not. basing 
your reasoning upon a given system of axioms, disprove the possibility that 
that system could lead to a contradiction. Now that teas a surprise to people, 
but I don’t think it ought to have been. After all, suppose a Ph.D student 
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came, breathless with excitement, and said ".Sir, I have proved that this sys¬ 
tem of axioms is free from all contradictions.” You'd say, "Did you prove 
it using only those axioms !” He might say, “Yes, I have hero written out 
a chain of propositions which demonstrate that these axioms arc free from 
all contradictions.” Well, iierliaps you'd look at him with mild surprise, 
and you might say, "I suppose you know that if this system of axioms did 
contain a contradiction, you could prove exactly those same propositions. 

We are faced, then, with the fact that the development of systems of mathe¬ 
matics must in part he an empirical and experimental process, analogous to 
the acquirement of further knowledge in the natural sciences. This is, I think, exem¬ 
plified very clearly in the development of our own subject of statistics. Many of the 
most important advances have been made by reasoning from the particular to the 

hlea of ti l r° m'""' r ° U,,<J ' T1,US ' for 0Xam >’ 10 ' il “Pl-oars ‘ho 

Idea of the property of sufficiency was suggested to Fisher by his discovery that if „ 

irnd s am estimates of the standard deviation ,r of a normal distribution, based on 

vie o7 ri"7 i , V,a,i0 " “ n<1 0,1 ,h ° mC “" <, ° Viati0n ‘hen for » given 

value of . the distribution of s' is independent of a. and that this is true also if any 
other estimate is substituted for s'. ^ 

Fisher was undoubtedly by far the most able mathematician to turn his 
attention to the subject of statistics in recent times. It is therefore curious-and 

to bavTr 0 I OUtl °° k ° f man ' V "“ thom ‘ ti “> statisticians—that there a,,pears 
to die T T' ,C, T?.campaign, both here and in the United States, designed 

whit hf v t 7 a n “ then, “* ,Cal " 0rk ' fOT example, told me that 

wh, o he was m the United States a statistician of some exjmrience remarked to him • 

But you wouldn t coll F„her a mathematical statistician, would you • and a stu 
dent Who had just obtained a Cambridge Diploma of Mathematical Statistics (with 
Distinction) indicated to me that he found Fisher sadly lacking in rigour. 

.. Tl ‘ at J ? 8her himsclf ro S ardcd ‘he abstract axiomatic approach to statistical 

::r;r g y storil ° is in<,icate,, by t,,e foiio ' rin « r;‘ 

of "r 

and treating it in the traditionally abstract and, I think, fruitless way 
haps that s why statistical science has been comparatively backward in ? 
European countries. Perhaps we were lucky in England in lime the ,T7 
mass of fallacious rubbish put out of sielit until u , .. 8 "holo 

probability in concrete terms and in lall able a^ ZT *** “T 
which we wanted the idea in tho natural sciences I am n ♦ *° PU ?° SeS for 
personal contact with the business of the improvement ofnaTjTkT 
in the natural sciences that is capable to keep straight th , kno " Ied g® 

matieally-minded people who have to grope their way thro Tth ° f math °- 
entanglements of error, with which at present they are very mfeh surr IZtl 
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I think it’s worse in this country (the U.S.A.) than in most, though T may 
be wrong. Certainly there is grave confusion of thought. We are quite 
in danger of sending highly trained and highly intelligent young men out 
into the world with tables of erroneous numbers under their arms, and with 
a dense fog in the place where their brains ought to be. In this century, 
of course, they will be working on guided missiles and advising the medical 
profession on the control of disease, and there is no limit to the extent to 
which they could impede every sort of national effort. 

The abstract axiomatic approach to the subject is reflected in the training 
that we give to mathematical graduates in our University Diploma courses in statis¬ 
tics. It would be dangerous to generalise—there are wide differences between uni¬ 
versities—but there is. I think, an excessive concentration on the more difficult parts 
of the mathematical theory and insufficient attention to practical problems. Thus, 
to take a very simple example. I suspect that few students are taught how to handle 
multiway tables of quantitative data with unequal weights (disproportionate frequen¬ 
cies). and none are taught how to handle similar tables of quantal datu (which is nut 
by x 2 )- Yet these types of data are of very frequent occurrence in real life. 


In deciding what diploma students should be taught wo must bear in mind 
their capabilities and what they will be doing in later life. Few of them aro brilliant 
mathematicians, some of them arc not oven very competent mathematicians. But 
this need not deter us. To make a good practical statistician, a man must have some 
innate mathematical ability, but he need not bo very expert in formal mathematics. 
Most diploma students will later bo engaged in practical applications of statistics 
or will be teaching statistics to others who will in their turn be engaged in practical 
applications ; only a few of the most brilliant wiU contribute substantially to advances 
in basic theory, and even those are only likely to make relevant contributions if they 
have a real appreciation of, and continue to have contact with, practice problems 
Any diploma course which fails t* give this appreciation, and a good all-round 
knowledge of how to handle the more commonly recurring practical problems, must 

be judged to have failed. 

What steps should we take to attain this desirable end 1 Firstly, I think, 
the general theory to be included in courses should be very carefully reviewed, «.th 
e f,,n of including only what is generally useful and necessary for an understanding 

? “JU >“■ ttrrrir 

tions ; certainly such esoteric s J Cambridge Diploma examination 

hlock designs 1 * * g °°“ 

in I960) should be omitted. ^ might b „ (lonc by a course of 
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bo suitable. To ensure that such a course is taken seriously students should be exa¬ 
mined on it. They might be permitted to bring copies of the relevant publications 
to the examination ; for the course to be effective the papers would in any case have 
to be reproduced. Thirdly, there should be greater care to include a proper range 
of questions on practical branches of the subject in the examination, so that students 
who have taken the trouble to acquaint themselves with these branches can gain 
credit thereby ; thus although the ‘elements' of quality control and sample survey 
theory are included in the London University syllabus no question on cither of these 
subjects was asked in 1961 or 1962. 

Whatevor their level, courses must be kept‘live’ and up-to-date. It is remark¬ 
able that nothing on the use of electronic computers in statistics and the changes 
they are bringing about in analytical techniques is yet included in the Cambridge 
Diploma course, or. to judge from the 1962 examination papers, in the London course. 

Finally, wo should endeavour to inculcate in our diploma students a sense 
of the duties and responsibilities of statisticians who are members of research teams, 
or who have to advise other investigators. That this is not at present done is indica¬ 
ted by the following question, taken from a recent Diploma examination : 

A clinician wishes to tind which of two drugs, A nnd B, both recom¬ 
mended for the same disease, is superior. He pairs off patients, ns they enter 
hospital, giving one of each pair the drug A and the other B and notes, at 
the end of a month's treatment, those pairs in which the patient given drug 
A has ‘ benefited' but not the one given B and conversely, ignoring pairs whero 
both, or ncithor. have benefited. Set up the appropriate sequential scheme 
with errors of both kinds set at 3 per cent and give an approximate expression 
for the number of patients he may expect to treat before reaching a conclu¬ 
sion. The clinician considers one drug preferable if it gives 10 per cont more 
chance of benefit than the other and expects 20 per cent of patients to show 
no benefit from the least effective of the two drugs. 

Indicate how you might modify the scheme if the clinician enter¬ 
tains the third hypothesis that the two drugs are equally effective and takes 
note of the numbers of pairs where both or neither benefit. 

What seems to me deplorable about this question is the implication that it 
is no part of the duty of the statistician to question the premises and procedure put 
forward by the clinician. Since a sequential scheme is envisaged, ho cannot plead 
that his advice was not sought before the investigation. Yet how can the clinician 
entertain the hypothesis that A is superior (by 10% or more) to B. or alternatively 
that B is similarly siqwrior to A, without at the same time entertaining the third 
hypothesis that they are equally effective (i.e. differ by less than 10 %); andin what way 
docs knowledge of the numbers of pairs where both or neither benefit (which give no in¬ 
formation on the question at issue) affect the problem, whatever hypotheses are ‘enter¬ 
tained' ; and finally would any clinician in his senses fail to note these numbers, which 
do give valuable background information on the general effectiveness of the two drugs ? 
62 .... 
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What about the introductory courses for mathematicians that are now boing 
drawn up for schools and Technical Colleges ? The Southampton Conference proposed 
the following syllabus for sixth form mathematical students at schools (age 16 - 18 , say) : 

Mean, median and mode of distribution. 

Standard deviation. 

Correlation by rank and by coefficient. 

Curve fitting to normal, binomial and Poisson form. 

Properties and parameters of those distributions and their applications to 
problems. 

Sampling, use in estimation and in significance. 

X 2 —Distribution, use for testing normality, contingency tables. 

Applications to such things as quality control. 


Is a course based on such a syllabus likely to stimulate the intorost of the stu¬ 
dent, or give him a useful introduction to the subject ? I think not. Who, in real 
life, wants to indulge in ‘curve fitting,’ and how, anyhow, can it bo done until prob¬ 
lems of estimation have been considered. And who in his senses would use the x 2 
distribution, rather than the third and fourth moments, to test for normality ; and 
what does ho do if the data aro not normal, other than press boldly on ?• No mention 
of dosign and analysis of experiments, or the t distribution. Correlation 'by rank 
and coefficient’, but nothing about regression : assuming the relevant table is avail¬ 
able (itself merely a variant of the ( table) correlation provides a quick, and therefore 
useful, test of the existence of association, but is liable to be grossly misused as a 
measure of degreo of association, and cannot, I think, be safely placed in the hands 
of the budding statistician without at the same time acquainting him with linear 
regression, which is often much more relevant, is no more difficult to compute, and 
can be readily assessed, when there is high correlation, by graphical methods. Graphi¬ 
cal methods also give a very necessary introduction to curvilinear regression. 


How should a youngster of 16 to 18 be introduced to statistics ? It seems to 
me that the first essential is to get across those branches of the subject which arc both 
simple and practically useful, and particularly those where clear-cut and definite 
conclusions can be drawn. There are three such branches that should bo well within 
the comprehension of a schoolboy: determination of the characteristics of a population 
by sampling, experimental error and experiments involving two treatments, and 
simple applications of regression. 

Do we start with continuous or discontinuous variates, the normal distribu¬ 
tion or the binomial distribution ? On this I have an open mind, but perhaps in view 
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of its greater general utility, and the fact that large samples from the binomial distri- 
ution can be conveniently dealt with by normal approximations, continuous variates 
are best. 


Random sampling can be introduced immediately by a practical exercise, 
o.g. by determining by sampling the average weight of a collection of stones. At 
the same time bias due to non-random sampling can be brought home by asking the 
pupils to select say three samples of live stones, each of which shall have an average 
weight as nearly as possible equal to that of the population. The histogram of the 
weights can he displayed. The distribution will not be normal. Hence the normal 
* istribution can he introduced in its proper perspective, as the distribution which 
oven «f not very closely followed by the original data, is much more closelv followed 
by the means of samples, etc. 


Wo may then. I think, proceod somewhat as follows : 

Estimation of the mean of a population by the mean of a sample, dis¬ 
tribution of the moan of a sample of a normal distribution, test of significance when <r 
is known of the difference of a mean from a given value, limits of error of the mean. 


Lack of knowledge of <r, its estimation. Practical example of the deter¬ 
mination of the accuracy of an estimate of the mean. e g. stones. 

Stratified sampling, with practical example, e.g. stones. Standard error of a 
l.nearfnnct, on of independently distributed quantities where standard errors are known. 


Calculation of the mean, and possibly the variance, of grouped 
(omitting Shepherd’s correction). 


observations 


Effect of estimation of <r on limits of error, the f-distribution (only important 
when the sample is small). 

Experimental error in simple laboratory determinations (emphasise that 
constant components of error will not he included in an estimate of error 
trom repeated observations). 


Simple comparative experiments on two treatments, without pairing 
Pooled estunate of error. Importance of random allocation of treatments. 

Comparative experiment, on two treatments with pairing, contrast with 
absence of pairing, potential gain in accuracy. 

nn ... E T T iment8 m0re than tn ° ,re ‘' tm0n ' S in ™domiscd blocks and 

possibly Latm squares. (Des.gn aspect, only, with mention that estimates of error 
and tests of significance are provided by the analysis of variance a 
which the student can find in a textbook if he requires it.) !< * Ue 

Simple probability problems for discontinuous variates. Illustration, 
games of chance, sex distribution in families, etc. ^ rom 


Binomial distribution and standard errors of p and np 
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2x2 contingency tables. Emphasise that these primarily provide estimates 
of p x and p z . Hence lead up to the test of significance for lack of association by 
using the standard errors of p x and p t derived from the marginal estimate of p. 
(This is exactly equivalent to the x 2 test, which can be mentioned as applicable also 
to larger contingency tables, etc. ; again refer to textbook.) 

Relations between two variates. Linear regression, graphically and numeri¬ 
cally. Curvilinear regression, graphically only. Use of linear regression (a) for 
prediction, (b) as a measure of causal effect (with suitable cautions), (c) for adjustment 
and standardisation to a given x value. (Bring in ratios here, as a simpler and at 
times appropriate method of adjustment; emphasise that ratios and other functions 
can often form the basic units for further analysis.) Use of correlation as a quick 
method of testing for (linear) association and in certain circumstance*, c.g. generatical 
work a useful measure in its own right. 


Index numbers (simple introduction). 

Seasonal variation (simple methods of elimination). 

Presentation of tabular matter. Graphical presentation. 

This may seem an extensive syllabus, but it is not too much, I think, for rea¬ 
sonably bright students and 6 hours teaching a week for 3 terms (the time envisaged 
for the syllabus quoted). 

So much for the schools. What of the Technical Colleges? Hero (part of 
a Diploma in Technology in Mathematics)* is one proposed first year syllabus (30 
hours lectures. 60 hours practical classes): 

(a) Purpose of statistics. Attributes and variables; population and 
sample. Collection and presentation of data, diagrammatic representation. 

(b) Discrete and continuous variates ; frecquenoy; grouped data. Fre¬ 
quency distributions, tabulations, histograms. Quantitative description of frequency 
distributions : measures of central tendency, dispersion, skewness and kurtosis. 

(c) Linear regression and correlation ; rank correlation. 

(d) Probability theory, definitions of probability, addition of probabilities i 
conditional probability ; multiplication of probability ; binomial fo.mula. 

(e) Probability distributions : frequency ami distribution functions ; "ela¬ 
tion to empirical distributions ; moments and moment generating function ; other 
generating functions ; cumulants ; the charactoi.st.c function. 

(f) Binomial distribution ; properties and applications. 

(g) Normal and Poisson distributions as limits of the binomial. 

(b) Properties and applications of the normal and Poisson distributions. 

(i) Goodness of fit: X* test - 

i: nf r tltpnrv • sampling from a normal population , 

distribution = introduction to test, of hypotheses based on the 

normal distributions. ----- 


• Soo Noto on p. 494. 
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Assuming that, the order is that which l he Icrtmcr is cxpcctwl to follow, T 
cannot help feeling that most of the students will rapidly gain the impression that 
statistics is a very dull and largely useless subject. We have our old friend ’measures 
of central tendency, dispersion, skewness and kurtosis’. beloved of writers of statis¬ 
tical textbooks, and all the paraphernalia of generating funct ions. Only at. t he very 
end of the course does the student learn that the distribution of the mean of a sample 
of a normal distribution is itself normal. Again no mention of experimental design : 
for this he has to wait until well on in the second year, when lie will learn about 
randomised blocks and Latin squares. 

He is then expected to do a year in employment—a sort of apprenticeship— 
before returning for a fourth year. It will no doubt be disturbing to his pride, and 
may well shake his faith in his teachers, if he finds himself in an establishment con¬ 
cerned with experiments, to discover that their analysis, if not relegated to a compu¬ 
ter, is mostly done by girls who left school at 10 or so. and that many experiments 
introduce factorial design, confounding, etc. of which he has never"heaid. He may 
have hoard of quality control in a course on Manufacturing Technology, hut ho can 
scarcely have had more than one lecture on the subject. Hut never mind, ho will 
havo learnt a lot about time series, including the largely discredited (I believe) 
method of poriodogrom analysis. 

In the fourth year statistics is offered as an ’optional special subject’ (00 
hours lectures. 30 hours tutorials, no praetieals). The student is required to take two 
such optional subjects. The statistics syllabus is comprehensive, but cannot possibly 
bo adequately covered in the time allotted. Some branches of the subject could well 
be taken further in the earlier years, but additional time is also required. Although 
it is stated in the ‘premises' that the growth of fruitful application of mathematics 
in the social sciences implies that it is not now necessary that all mathematicians 
should be extensively educated in physics and mathematical physics', * Modern Mathe¬ 
matical Physics’ (30 hours) and History and Philosophy of Mathematics and Mathe¬ 
matical Physics* (30 hours) are compulsory to all fourth-vear students. The course 
on ‘Modern Mathematics’ (On hours) is also compulsory ; this course, which comprises 
sot theory, algebraic structures, metric spaces and topology, functions of real variables, 
theory of measure, linear operators, appears to be of negligible interest to statisticians. 

The other optional special subjects of interest to the statistician are Numeri¬ 
cal Analysis, Mathematics of Operations Research, and Digital Computers. It would 
seem appropriate that he should take all three, instead of only one, but this would 
require an additional 180 hours, against 120 hours gained if the compulsorv courses 
abovo aro abandoned. However 180+ hours arc allotted to a ‘Special Investigation.’ 
Such investigations are difficult to organise, make severe demands on the supervisor, 
and aro not really suited to immature students (witness the futility of many Ph.D. 
and M.Sc. investigations). The 120 hours remaining aftor allowing for the additional 
60 hours above could well be devoted to organised practical work, and to additional 
lectures in statistics, including possibly a course on selected published investigations 
of the type suggested above for universities. 
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Note: Since th 'S paper was written I have learnt that copies of the draft of the 
Technical College scheme from which the statistics syllabus quoted above was taken 
was submitted to many people, academic, research and industrial, for their criticism 
and suggestions, but only one (a member of my staff) criticised the statistics 
syllabuses. As a result of this criticism these syllabuses have been considerably revised 
and improved. Changes have also been made in the organisation of the fourth year 
course, the most important being that the number of optional subjects to be taken is 
raised from two to three, the course on Modern Mathematical Physics is omitted, and 
Mathematical Physics is excluded from the course on History and Philosophy. This is 
very encouraging, but as the Head of the Department of Mathematics writes : “The 
freedom allowed colleges in the drafting of schemes for Diploma in Technology courses 
gives us a chance of offering an up-to-date education; but to take advantage of this 
those of us who have been long in technical education must depend much upon authori¬ 
tative advice.” It is up to statisticians to provide this advice : and to do this effec¬ 
tively we must ourselves do somo clear thinking. 
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SCIENTIFIC CONTRIBUTIONS OF 
PROFESSOR P. C. MAHALANOBIS 

(Figures within ( ] refer to the serial numbers of papers listed at the end) 

It is not easy to make a proper assessment of the scientific work of Professor 
P. C. Muhalnnohis as lus contributions have highly individual and even unique qualities. 
He did not consider statistics as a narrow subject confined to the mathematical theory 
of probability or routine analysis of data in applied research or collection of facts 
as an aid to administrative decisions. Ho has. indeed, made signal contributions to 
each of these aspects of statistics. But he took a wider view of statistics as a new 
technology for increasing the efficiency of human efforts in the widest sense. This 
has naturally aroused his interest in various fields of scientific enquiry and applied 
problems and enabled him to enrich the science of statistics with a practical base 
of great depth and spread. 

1. Leader of statistical movement in India 

To narrate the achievements of Professor Mahalanobia in the field of statistics 
would mean narrating the recent history of statistical development in India. Statis¬ 
tics as a separate discipline was recognised by the scientific world even in the most 
advanced countries of the world only at the turn of the present century, and in India 
it was practically unknown in the first quarter of the century. There was no teaching 
of or research in statistics at the universities, no statistical society or journal of statis¬ 
tics. The official statistics were collected only as a by-product of administration. 
A sudden spurt of statistical activity occuircd about 30 years ago which was to put 
India, in the course of a few years, not far from the centre of the world statistical 
map. The Indian Statistical Institute with facilities for liigh-levcl research, train¬ 
ing and execution of large scale project work was founded by Malialanobis in 1931 . 
'Sankhtja', the Indian Journal of Statistics was started in 1933, of which 25 
volumes have boon published and of which he remains editor to this day. Sample 
surveys on a large scale covering whole provinces were started on behalf of Govern¬ 
ment under the leadership of the Institute from 1937. The first Indian Statistical 
Conference was held in 1938 under the Chairmanship of the late Sir Ronald Fisher. 
Post-graduate courses in statistics were 0 ]>encd for the first time in India in the 
Calcutta University in 1941 under the guidance of Mahalanobis; similar courses were 
opened in other universities subsequently. The Indian Science Congress decided 
to start a separate section for mathematics and statistics in 1942 and a separate 
section for Statistics in 1945. A Central Statistical Unit was established by tho 
Government of India in 1949. to work under the technical guidance of Professor 
Mahalanobis ns Honorary Statistical Adviser to the Cabinet; two years later tho 
Central Statistical Organisation was started and still later a Department of Statistics 
was created which is still working under Mahalanobiss guidance. The National 
Sample Survey was established in 1950 for the collection of socio-economic data 
through sample surveys on a continuing basis, a unique feature in a national 
statistical system. The Indian Statistical Institute was recognised as an institution 
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of national importance and empowered to award degrees in statistics by a Central 
Act in 1959. 

This phenomenal progress was due to the foresight, leadership and efforts of 
Professor Mahalanobis. As the founder-director of the Indian Statistical Institute 
he has been taking the initiative in expanding the Institute's scope of activities and 
in increasing the field of application of statistical methods in many directions. The 
movement which started in 1932 was itself the result of the deep conviction which 
the Professor had developed, during the preceding ten years of advanced studies and 
research in various fields, about the importance of statistics in an under-developed 
country like India. 

Professor Mahalanobis was drawn into statistics by a series of random events. 
After taking his honours degree in India, Mahalanobis joined King s College, 
Cambridge University, in 1913 for higher studies and research; he took Part I of Mathe¬ 
matical Tripos in 1914 and Part II of the Physics Tripos, with a first class in 1915. 
Ho returned to India in 1915 with the intention of going back to Cambridge 
for research in physics for which lie had been awarded a senior scholarship by King s 
College. 

Just before his departure from Cambiidgo, his tutor, W. H. Macaulay, had 
quite casually drawn his attention to the journal Biomttrika and Biometric Tables 
edited by Karl Pearson, copies of which Mahalanobis brought with him to India; 
studying these volumes he got seriously interested in statistics. Soon after his 
return to India he accepted the post of a professor of physics at the Presidency College, 
Calcutta, and decided to stay in India and carry on his statistical studies alongside 
his work of teaching physics. A little later in 1917, Sir Brajcndra Nath Seal (then 
University Professor of Philosophy) had asked Mahalanobis to help m the work ol 
a committee, appointed by the Calcutta University, to enquire into the examination 
system ; this offered good opportunities of using statistical methods for the analysis 
of examination data. Mahalanobis also got other problems, usually of a practical 
nature (relative efficiency of different types of vaccines, effect of weather conditions 
on incidence of diseases, inter-caste marriages etc.) on which several notes and reports 


were prepared. 

Speaking about the early activities of Mahalanobis the late Sir Ronald Fisher 
had observed — 

-In those early days Professor Mahalanobis was a Professor of Phys.cs 
but was no ordinary Professor of Physics. Instead of doing h.s duty and 
teaching his students, only that science and technology winch has led o 
the atomic bomb, he thought that he would serve the fc low-men by^opernng 
the door to knowledge, obtained by statistical means, to knowledge of the 

natural world and knowledge of the world of society m "Inch we all find 

ourselves Perhaps, he thought, as many of us think, that most of the foll.es 
a ri nes of the Government are due to ignorance-ignorance of the people 
they serve, and the ignorance of the people whom they are all too wUhog 

to fight.” 



SCIENTIFIC CONTRIBUTIONS OF PROFESSOR P. C. MAHALANOBIS 497 


2. Mahalanobis Distance 

For some time Mahalanobis carried on his statistical studies in his own home 
with the help of part-time computers engaged by him. A chance meeting with N. 
Annandale (then Director of the Zoological and Anthropological Survey of India) 
at the Nagpur Session of the Indian Science Congress in 1920 led to Mahalanobis’s 
first systematic work on a statistical study of the anthropometric measurements 
taken by Annandale on Anglo-Indians (of mixed British and Indian parentage) in 
Calcutta. Mahalanobis’s first paper [1] was on 'the Statistical Analysis of Anglo- 
Indian Stature’ which was published in the Records of the Indian Museum in 1922. 
This was a remarkable pai»er in many ways and exhibited the abilities of Mahalanobis 
as a statistician, to cross examine his data, to extract the information by appropriate 
statistical methods and to suggest further lines of investigation. Then followed 
a scries of papers [0, 10, 11. 12, 13. 14, 23, 37, 58. 59, 62, 66, 76, 78, 81, 100, 129] on 
the theory and application of multivariate analysis to anthropological data the most 
important of which is [6] the ‘Analysis of race mixture in Bengal’, the Presidential 
address delivered to the Anthropological Section of the Science Congress. 

The anthropometric studies led to the formulation of /^-statistics, known 
in statistical literature as Mahalanobis distance, which has proved to be a valuable 
tool not only in taxonomy but in many other fields including economics and geology. 
He had also discussed the problem of statistical taxonomy from a logical point of 
view in 1937, and had laid down the fundamental axioms (hypotheses) under which 
a stable classification of taxa could be obtained [62], A rich field of research in multi¬ 
variate analysis opened up, to which some of his colleagues at the Institute made 
valuable contributions. 


3. Mkteokolooical research 

In accordance with the usual practice, Mahalanobis’s paper on statistical 
analysis of the stature of Anglo-Indians had been referred to Sir Gilbert Walker (then 
Director General of Observatories) for opinion which led to Sir Gilbert asking Mahala¬ 
nobis to undertake a statistical study of some meteorological problems. This resul¬ 
ted in two memoirs [2. 3] and a note [4] on upper air variates being published in 1923. 
Statistical deviations from the average were for the first time explicitly separated 
from experimental errors of observations. This led, by purely statistical methods, 
to the location, at the height of about 4 kilometers above sea level, of the region of 
highest control for changes in meteorological conditions on the surface of the earth 
(a result which was rediscovered several years later by Franz Bauer in Germany from 
physical considerations). 

The meteorological studies led to Mahalanobis being appointed Meteorologist 
in Calcutta, in charge of the eastern region; he worked in this post for more than 3 
years from 1922 to 1926 in addition to his duties as professor of physics at the Presi¬ 
dency College. During this period ho started some work on the statistical analysis 
of meteorological data; in one study he found that there was greater rainfall in 
Calcutta in July during the darker phase of the moon and that the difference was 
statistically significant ; these results were published several years later [ 67 j. 

63 
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4. Reconstruction of information through scrutiny 

Most of the statistical methods available in the early twenties took into ac¬ 
count only the variability of measurements (i.e. of individuals) in a population but not 
of the additional variation due to errors of measurement. These errors may be of a 
random nature inherent in any method of obtaining a scale reading or of a systematic 
type introducing a bias, or due to wrong recording. Such errors, if not recognised and 
allowed for in statistical analysis, may lead to wrong inferences. Mahalanobis seems 
to have been the first to point out and study the effects of measurement and recording 
errors on statistical parameters. In liis memoir [3] on the analysis of meteorological 
data of the upper air published in 1923 he worked out the effects of errors of measure¬ 
ment on the estimates of the correlation coefficient and standard deviation. 

He developed a highly scientific method of scrutinising data for recording and 
systematic errors, and reconstructed a large series of anthropometric measurements 
published by Risley, which had been earlier condemned as faulty and unsuitable for 
statistical analysis being full of errors [23, 37J. This is a difficult problem in extrac¬ 
tion or reconstruction of information, which is indeed more of an art in which Maha¬ 
lanobis is a great master. He has an uncanny sense for figures and can often point 
out at a glance mistakes in any scries of figures coming under his scrutiny. Ihc 
publication entitled, Revision of Risley’s anthropometric data’ in the first number 
of SankhyS in 1931 brought a letter of appreciation from the late Sir Ronald Fisher. 


5. Early examples of operations research 


In 1922 a disastrous flood had occurred in North Bengal. An expert 
committee of engineers appointed by Government were about to recommend the 
construction of expensive retarding basins to hold up the flood water when the 
question was referred to Mahalanobis for examination. A statistical study of rainfall 
and floods extending over a period of about 50 years showed that the proposed retard¬ 
ing basins would be of no value in controlling floods in North Bengal. Floods wore 
occurring in the area because of obstructions to the outflow of the excess rainfall by 
river and railways systems without adequate bridges ; the real need was improve¬ 
ment of rapi.l drainage and not holding up the flood water. Specific remedies were 
recommended, many of which were implemented and proved effective [9]. 


A similar question of flood control in Orissa was referred to Mahalanobis. 
after a severe flood in the Bral.mini river in 1926. This resulted in a detailed study 
of the areal and time distribution of rainfall in relation to floods in Orissa iron. 
An expert committee of engineers were of opinion that a catastrophic rise had 
occurred in the river-bed of the Brahmani, and they recommended increasing the 
height of river embankments by several feet. The statistical study covering a 
period of about 60 years showed that no change had occurred m the river bed, 
showed that the construction of dams for holding up of excessive flood '™ ter m the 

be of value m this region [15. 16, 83], 
that the real need was to construct dams in the 
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upper reaches of the rivers to hold up the water for purposes of flood control and 
generation of electric power. He also gave the first calculations for a multi-purpose 
(flood control, irrigation and power) schema for the Mahanadi system in Orissa, which 
formed the basis of the Hirakud hydroelectric project which was inaugurated about 
thirty years later in 1957. Two big reports wore submitted incorporating the 
extensive studies of rainfall and floods in Orissa [15, 16 ]. Some of the results in 
the reports on rainfall and floods were published in a summary form in a papor [83]. 

Tn retrospect one finds that Mahalanobis’s early work on river floods is in the 
nature of Operations Research which has been introduced as a separate discipline after 
the second world war. Another example of such an approach is the study he made 
in a note [61] submitted to the Government of Bengal in 1937 on the Hooghly-Howrah 
flushing and irrigation scheme. He had estimated the expected increase in yield of 
paddy by the introduction of an irrigation scheme by which high floods in the 
Damodar river were intended to be used to supplement the rainfall. This report 
was of help in developing in later years the Damodar Valley multi-purpose hydro¬ 
electric project. 


6. Educational tksts 

Mahalanobis develoj>ed an interest also in the construction and performance of 
educational tests in his early days of statistical research. Group tests in the medium 
of tho Bengali language were constructed and used in the Institute [22, 36, 39]. Stu¬ 
dies were also made of the correlation between intelligence or aptitude tests and success 
in school leaving certificate and other examinations, and of standardisation of tests 
[42, 57, 63]. 


7. Errors in field experimentation 

In 1925 Mahalanobis had the occasion to study the probable errors of results 
of agricultural experiments in which six varieties of paddy had been sown in a syste¬ 
matic manner in ten replicated blocks. In the resulting paper [7] the variation in 
soil heterogeneity was sought to be eliminated by fitting non-linear graduating curves 
(a method wliicli was used independently by J. Nevman several years later). In com¬ 
plete ignorance of the work on the design of experiments done a little earlier by R. A. 
Fisher, Mahalanobis suggested in this paper that each strip or plot should be divided 
into a number of sub-plots with a view to securing replicated observations for the 
computation of error. This paper placed him in touch with R. A. Fisher, and Maha¬ 
lanobis immediately began to study seriously Fisherian methods of field experiments. 
During a visit to England in 1926, he met Fisher and close personal relations were 
established. The friendship between Mahalanobis and Fisher was strengthened 
by Fisher’s frequent visits to the Indian Statistical Institute, specially durina the 
last ten years. They had common views on the foundations and methodological 
aspects of statistics and also on statistics as a new technology of the present age. 
Sir Ronald’s death in 1962 removed a very close friend of Mahalanobis. 
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Mahalanobis did valuable service in introducing in India as early as 1929 
Fisherian techniques in conducting field experiments and analysis of data. A number 
of papers by himself and in collaboration with his colleague S. S. Bose have appeared 
during 1932 and 1940 on field experimentation and related statistical methods 
[17-21. 24, 34, 38, 40, 43, 44, 46-51, 53, 54, 65, 68, 71, 80, 82, 89]. 


8. Sample surveys, sequential sampling and interpenetrating 

NETWORK OF SAMPLES (IPNS) 


Then came the epoch making investigations on the technique of large scale 
sample surveys, with which Professor Mahalanobis’s name will always be associated. 
Systematic work on survey of agricultural crops began in 1937, which culminated 
in a large scale survey of the acreage and yield of Jute crop in 1941, covering the whole 
province of Bengal, and wasextended to all important crops in both Bengal and Bihar 
in 1943. This was followed by sample surveys for collecting socio-economic 
data, public preference etc. (69-75, 79, 84-88, 90-99]. These demonstrated the 
possibility of using large-scale sample surveys to collect information quickly and eco¬ 
nomically with sufficient accuracy for most practical purposes. Three notable contri¬ 
butions were made to the technique, namely, the concept of optimum designs of 
surveys (to give the highest precision at a given cost or the minimum cost for an assig¬ 
ned level of precision), pilot surveys and interpenetrating sub-samples. The pilot 
surveys represent a very general approach of which a significant example is sequential 
sampling developed 10 years later by tho late Abraham Wald, and provide a systema¬ 
tic method for progressively improving the design of the survey, utilising tho previous 
information on cost and variance functions. The interpenetrating network of samples, 
used in a proper way, is the only possible method to estimate non-sampling errors 
which arc inevitable in large-scale sample surveys and which arc sometimes of a largor 
order of magnitude than sampling errors; also the estimation of tho non-sampling 
errors is necessary for assessing the precision of a final estimate. The first full-length 
treatment of these concepts is contained in the memoir on large-scale sample surveys 
which appeared in 1944 in the Philosophical Transactions of the Royal Society [110]. 

Speaking about the originality of ideas which Mahalanobis was trying out 
in the development of sample designs for estimation of Jute crop, the late Sir Ronald 


mentioned :— 

-What was striking therefore in the Indian contribution to the problems of 
sample survey, was that it combined a clear realisation of statistical principles with 
a down-to-earth experience of the practical difficulties, in a country in winch education 
was on the whole, backward, of getting such work done, on a large scale, and yet 
with the primary scientific requirement of ascertainable and demonstrable P™. 
From that point the standard set has never gone back, and publicly orgamsed cen¬ 
suses and surveys in all parts of the world look to the Indian Sample Survey as a basis 
^ comparison. Difficulties, of course, there are, in India, and also elsewhere, but 
Z speed and economy, as well as the accuracy of sample surveys when competently 
organised, have now been put beyond question. 
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A large number of surveys were conductod from 1937 to 1950 in Bengal for 
collecting information on crops and socio-economic data which gave opportunities 
for improving the design of sample surveys and for gaining experience in the collec¬ 
tion of data from the field (102-115, 118-120. 122-127. 132-135, 138, 139, 141]. 
Time was ripe for launching nationwide sample surveys. Several hurdles had to he 
crossed in convincing the administrators that gaps in national statistics could lie filled 
through data obtained bv sampling and there would l»e a need for continuous collec¬ 
tion of information to assess the progress of economic development and to make 
policy decisions. Mahalanohis won the battle and in 1950 the National Sample 
Survey was established. It is a continuing survey, in which information is collected 
year by year with the help of a whole-time field organisation, spread all over India, 
and provides periodic estimates on social and economic factors affecting the 
national economy (142, 146, 170, 179]. 

9. National planning 

In 1954, at the request of Prime Minister Nehru and the Planning Commission 
of India, Mahalanohis undertook a study to find ways and means of increasing national 
income at a reasonably rapid rate and at the same time solving the problem of unem¬ 
ployment if possible in 10 years. The problem of national development had been 
engaging the attention of Mahalanohis even earlier. In his Presidential Address, 
‘Why Statistics'? to the Science Congress in 1950 (131] and in two lectures [140, 143] 
in 1952 he gave sonic calculations emphasizing the need of a high rate of investments 
in heavy industries. Elaborating on his earlier ideas [144, 148J Mahalanohis deve¬ 
loped econometric models (known as Mahalanohis's two and four sector models) for 
determining optimum investments in different sectors of the national economy 
(149-154, 156-165] and lie submitted to Government the Draft Plan-framo for the 
Second Five Year Plan of India in 1955. Mahalanohis s findings supplied a rational 
strategy for national development and formed the basis of the Second and Third 
Five Year Plans of India. He is continuing liis interest in the planned economic 
development of India as a Member of the Planning Commission of India. In recent 
years ho has taken special interest in requirements of technical and scientific man¬ 
power and the need of establishing the scientific base for a rapid economic and social 
progress of India (166-170, 172, 174, 175, 177, 178, 180, 181]. 


10. Fractile graphical analysis 

It is said that often a scientist's best work is done in his young age and as 
he grows old ho can only elaborate on his earlier ideas. But Mahalanohis socins to 
be an exception in this respect. During his long years of research he has been conti¬ 
nually providing new ideas and new tools which would form permanent additions 
to statistical techniques. To the generalised distance and axioms of taxonomy, 
pilot surveys, inter-penetrating sub-samples (IPNS), concepts of randomness of space 
fields, and economic growth models, he has recently (1958) added the new and power¬ 
ful tool of Fractile Graphical Analysis (FGA) (158). 
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This novel approach was developed out of a necessity to compare the socio¬ 
economic conditions of groups of people, differing in place and time, using the data 
collected in the various rounds of the National Sample Survey. The method is simple, 
extremely versatile with a very wide field of applications, and can be modified to 
meet various needs. The method is graphical and is based on a geometrical concept 
of error which enables a study of the relationsliip between two variates, and can also 
provide a generalised measure of the separation or the generalised difference between 
two different “universes” of study. Considerable research has been done on theore¬ 
tical aspects and a good deal of experience has been gained in the use of F.G.A., in 
various fields (like economics, demography, psychometrv, botany, biometry, physical 
measurements etc.) during the last few years and there is now a sizeable literature 
on the subject [173, 180]. 


Editors 
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Rashtrapati Bhavan, 

Nbw Delhi-4, 

«frcft-41 

July li; 1963 

I am happy to know that 
Professor P.C.Mahalanobis has 
recently completed his seventieth 
year. Hjs outstanding contri¬ 
butions in the field of Statistics 
have earned him world-wide 
recognition. Hj s work has been of 
much use to us in our development 
planning. I send my best wishes to 

him for many more years of useful 
work. 


(S.Radhakrishnan) 



WR 

PRIME MINISTERS HOUSE 
NEW DELHI 

Dehra Dun, 

June 2, 1963 


I am happy to join in the felicitations 
offered to Professor P.C. Mahalanobis on his 
seventieth birthday. I have known him for several 
decades and have come into close contact with him 
particularly since we attained independence and he 
has been connected with the Central Statistical 
Department and the Planning Commission. An eminent 
scientist and the builder up of the Indian Statistical 
institute which has become one of the leading centres 
of statistical work in the world, I have been deeply 
struck by his broad and comprehensive approach to 
national development and his astonishing energy. 

He is full of ideas and it is always a pleasure 
to discuss any subject with him. The record 
his achievements and the work of national develop¬ 
ment and international cooperation is a formidable 
one. in paying my tribute of admiration for the 
work he has done, I earnestly hope that he will 
have many years more of service to the causes he 
has devoted himself to. 
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Academy of Sciences, Bulgaria 

May I be allowed in the first place to congratulate you most cordially on the 
glorious 70th anniversary of your birth and on your Ion? and remarkable scientific 
and public activities by which you won renown and respect in all countries, including 
ray Homeland, the People’s Republic of Bulgaria. 


My feelings of joy on the occasion of your 70th birthday arc naturally linked 
with the reminiscences, pleasant to every Bulgarian, of your collaboration with the 
outstanding Bengalee poet and thinker Rabindranath Tagore whom you accompanied 
during lus tour of Europe in the twenties of this century and with whom you visited 
our country for the first time. 


1 ulganan scientists are well aware of your merits in the field of statistics 
and ot its application in science and practice, as well as of your vast learning and 
interests in science and culture, and your merits as an outstanding champion of peace 
and well-being for the peoples. 

T. D. Pavlov 


Honorary President 

Academy of Sciences, Czechoslovakia 

Information has been received that the Czechoslovak Academy of Sciences 
has decided to award the Gold Medal of the Academy for meritorious service to 
science and mankind to Professor P. C. Mahalanobis, 


Academy of Sciences, Poland 

On behalf of the Presidium of the Polish Academy of Sciences and the 
Pohsh research workers I have the pleasure to extend to you our cordial congratula- 
t.ons on your Seventieth Birthday and to convey you an acknowledgement of V our 
untiring efforts and magnificent successes you have achieved in many fields of learning. 

The Polish research workers know you as an eminent scholar, excellent 
organiser of se.ent.fie, economic and social life, and highly appreciate vour works 
and vanous activities as well as your contribution to India's planned ' economical 
development. Your scientific works on economical and statistical topics.-the fields 
m which you are renowned authority .-have been particularly studied and estimated 
in our scientific quarters. 

tv 1 al r , add ° Ur b0St COngratulatio,ls for >' ou “ “ founder, organiser and 

D.ieetor of the Indian Statistical Institute, now one of the most outstanding world 

research centres ... the field of statistics with which the Polish research worker! have 
already had an opportunity to establish scientific relations. 

I should like to send you on this occasion our best wishes for many happv 
~tuxns and many yearn which you wiil have the opportunity to carry out /our 
ideae Lookmg forward to your enjoying a perfect health that will onable * 

~m°, I^ta S0 “ C DeW rCSp ° nSib,C 18816 ^ StUi “ Wait years to 

Janusz Qroszkowski 
President 
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Academy of Sciences, U.S.S.R. 

The Academy of Sciences of U.S.S.R. warmly congratulates you, a scholar of 
international reputation, one of the prominent figures of Indian Science, on the occa¬ 
sion of your 70th birthday and wholeheartedly wishes you a healthy and long life 
and further fruitful work in the interest of the Indian people and to the profit of world 
science. 


The Soviet scholars are well aware of your great and multifarious scientific 
and scientific-pedagogical activities which started nearly half a century ago. We 
have a high esteem for your distinguished contributions to the development of Indian 
and world-science. The field of your scientific interests is wide: Physics and Mathe¬ 
matics, Meteorology and Hydrology, Anthropology and Sociology, Demography 
and Economics. Your achievements in the fields of theoretical and applied statistics 
have been recognised by the scientific circles throughout the world. 

Under your directorship, the Indian Statistical Institute has acquired a well 
merited authority in the whole world. The investigations conducted in the Institute 
and its departments and the creation of highly qualified specialists have a great signi¬ 
ficance for India and also for other countries. 


In our country, your name is well known not only to the scholars but also 
to a wide circle of Soviet public. You are known here as a champion for the cause 
of progress and development in India, as a fighter for the cause of economic stability 

in your country. 


Dear Professor ! Soviet scholars have a high esteem for your sciontiflc and 
social achievements, your accomplishments in international scientific collaborat.on 
and for the scientific bonds you have established and strengthened between the Sovrnt 
Republic and India. 


The recognition of your achievements in world-sc.ence .s reflected m you 
having been elected as a foreign member of the Academy of Scences of U.S.S.R. 
a fellow of Royal Society and of many other foreign sc.ent.fic orgamzat.ons. 


On this Jubilee day. we extend our greetings to you, a citizen of great India, 
a progressive social worker and a scholar of international reputat.on. 

For and on behalf of the Presidium of the Academy of Sciences, U.S.S.R. and 
Soviet scholars. 


}I. V. Keldish 
President 
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American Statistical Association 

It is a pleasure to extend to Professor Mahalanobis the congratulations of 
the American Statistical Association on this, his seventieth birthday. His record of 
sustained accomplishment in the field of survey methods and sampling theory is too 
well known to need recounting here. We of the American Statistical Association 
are particularly indebted to him for his many demonstrations of the value of scientific 
survey design in government statistical work. His challenging use of interpenetrat¬ 
ing samples for the evaluation and control of error in large scale surveys will in the 
years to come continue to ensure improvement in the field to which lie has given so 
many years of dedicated service. We arc especially proud that he is a Fellow of 
the Association. 

Raymond T. Bowman 
President 

Biometric Society 

On the occasion of his 70th birthday, the Biometric Society is most happy 
to send its greetings to Professor P. (J. Mahalanobis. From the foundation of our 
Society in 1917, Professor Mahalanobis has been a valued member; he served as one 
of our first Vice Presidents and was for many years an elected member of our Council. 

The high repute of Indian work in statistics and biometry owes very much 
to Professor Mahalanobis's enthusiasm ami hard work. By comparison, the Biome¬ 
tric Society is a very new growth. Yet we remember gratefully how. in December 
1951, his invitation enabled us to hold our First International Biometric Symposium 
in the new buildings of the Indian Statistical Institute. The theme of that 
Symposium was“Biometric Problems in the Prediction and Estimation of the Growth 
of Plants in Tropical and Subtropical Regions.” and Professor Mahalanobis contri¬ 
buted substantially to the proceedings with his paj>er “On the Size of Sample Cuts 
and Crop Cutting Experiments in the Indian Statistical Institute: 1939-1950.” He 
also arranged for the publication of the 110-pagc Proceedings of the Symposium by 
the Press of the Institute. 

In its constitution the Biometric Society defines its objectives as “the ad¬ 
vancement of biological science through the development of quantitative theo¬ 
ries and the application, development, and dissemination of effective mathematical 
and statistical techniques.” These objectives have been shared so fully by the Indian 
Statistical Institute under Professor Mahalanobis's direction, that wo have always 
had a strong feeling of kinship with the Institute and its staff as a major center for 
advancing our aims in this part of tho world. Moreover, the continuous flow of visit¬ 
ing statisticians and biometricians from all parts of the world through the doors of 
the Institute has been an important aid to international cooperation among scientists 
in all fields that lie close to biometry. The Biometric Society has been particularly 
eager to encourage this kind of cooperation. 

Many officers and members of our Society have enjoyed the hospitality of 
the Institute, and the personal hospitality offered so graciously by Professor and 
Mrs. Mahalanobis in their home. I know that I express the hope of all members when 
I wish Professor Mahalanobis many more years of effective scientific work and vigo¬ 
rous leadership in the subjects to which he has already contributed so impressively. 

C. 1. Bliss 
President 
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Ecolc des Hautes Etudes, Sorbonne, Paris 

W e ex I ,ress our good wishes and admiration for you on the occasion of your 
70th anniversary. 


Ferrand Brundtl 
President of the Section of 
Economic and Social Sciences 


Geographical Society of the U.S.S.R. 

The Geographical Society of the U.S.S.R. under the Academy of Sciences 
felicitates you, an outstanding scientist, a public and social worker of our day, on 
the occasion of your 70th birthday. 

Your indefatigable efforts for all-sided development of advanced scienco in 
your mother country, your constant efforts for widening international cooperation in 
the interests of peace in the whole world, for progressive humanity and for a rise in 
the economic and cultural level for the less fortiuiatc regions of the world, for your 
long-drawn out struggle against colonialism and its heavy legacy in your country as 
well as in the world—all this has stimulated a feeling of deep respect and friendship 
for you among the Soviet scientific community as a whole. 

One of the illuminative expression of such feelings and recognition of your 
great scientific service is your unanimous election as a foreign member of the Academy 
of Sciences, U.S.S.R. 

The Soviet geographers are very highly impressed by the nature of your 
scientific activity, the extent of your vision, your lively interest in natural sciences 
and researches in the domain of social sciences and your efforts towards establisliing 
intimate creative relation between theory and practice. 

Already at the beginning of your scientific career as the Chief meteorologist of 
Calcutta and as the Head of the Department of Physics of the Presidency College you 
conducted original scientific investigations to fight the menace of floods in Eastern 
India and formulated advanced ideas of an integrated approach to the reconstruction 
of the Indian river system. Even as far back as that, your interest in statistical 
investigation came to be revealed. 

The tasks of building up a new independent India attracted your attention 
to the problem of scientific planning, to the elaboration of a programme of economic 
development for the young Indian Republic, to the problems of exploitation of the 
rich and varied natural resources and rational geographical distribution of the develop¬ 
ing productive forces of the country. Well-known are your contributions to tho 
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formulation of the scientific principles and elaboration of the five-year plans for eco¬ 
nomic and cultural construction in India. You can be rightfully considered to bo 
the initiator and champion of intensive studies in the problems of planning and regio¬ 
nal planning in the Indian Republic. 

The Soviet geographers have the satisfaction that in this important scientific 
and governmental activity you with your characteristic perspicacity have unceasingly 
encouraged extensive geographical investigations of the Nature. Economy and Popula¬ 
tion in India and widening in all possible ways the contacts between the Indian and 
Soviet scientists and specialists working in the domain of geography as well as in 
other domains of knowledge. 

We respond to your 70th birthday with full assurance of our cooperation and 
trust in this that the friendship between the peoples of India and U.S.S.R. will go on 
being strengthened and extended. 


5. V. Kolesnik 
Vice President 


Indian Mathematical Society 

On the occasion of completing his seventieth year, the Indian Mathematical 
Sooiety conveys its warm felicitations to Professor P. C. Mahalanobis, F.R.S., and 
wishes him many more years of happy life and service to the country. Starting liis 
career as a Professor of Physics. Profossor Mahalanobis took Statistics as a hobby, 
and steadily built up a school of Statistics, practically from scratch. His name will 
be ever remembered for his pioneering work in India in tho field of Statistics, and for 
building up a strong and well-planned edifice for it. Our warm congratulations. 

C. N . Srinivasiengar 
President 


Institute of Asia Economic Affairs, Tokyo 

On the 70th Anniversary of your birthday I have great pleasure in extending 
to you my warm congratulation and best wishes for your happiness. 


Sciichi Tobata 
President 
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Indian Science Congress Association 

In honouring Professor Mahalanobis on his seventieth birthday we are honour¬ 
ing not only a great man and leader of Science, but also one whose' contribution in 
recent years in the field of planning and development of our country has been of the 
utmost importance: He has been a pioneer in a real sense. He has been one of the 
main architects of the Indian Science Congress. He was the General President in 1950. 
His work and example have inspired many, and would continue to be of unfailing 
source of inspiration for years to come. We pay our respectful homage and tribute 
to him. and sincerely wish him many years of happy and fruitful life, devoted to the 
service of science and the betterment of man. 


D. S. Kothari 

President 


Institut de France Academie des Sciences 

In collaborating in the collection of memoirs which are going to bo dedicated 
in homage to you I have given expression to the high esteem in which I hold your 
scientific works and their applications and the advancements which you have made 
in the education and application of statistics in India. 

I can assure you without going in for votes (and I have been authorised to 
inform you) that the sentimonts which I have expressed are also shared by my 
co-workers in the Academy of Sciences. We also ho|»e that the bonds of friendship 
which have been forged between your great country and ours during the past yoars 
may continue being strengthened. Permit mo, my dear colleague, to express my 
most cordial and best regards for you. 

Maurice Frechet 


International Statistical Institute 

Professor Mahalanobis includes—among the many up-to-date and creative 
facets of his personality-the secret of remaining dynamic. Only the wisest people 
of our dav know how to keep young-to widen the gap between their actual and 
biological age. If he were not so well known with his name and biograplucal details 
in hundreds of publications, no one would believe that Prasanta Chandra Mahalanobis, 
with his commanding presence, black hair, lively expression and readmess to act 
had reached the seventy year mark, which all over the world, usually means retirement 
for university professors. 



MESSAGES 


525 

But appearances arc belied by a vast output of work which must, of necessity, 
extend over many years of study and covers, with real ent husiasm and thoroughness, 
many fields of theoretical and applied statistics — methodological statistics, anthropo¬ 
metry and biometry, agricultural cx|»crimcntation, meteorology and hydrology, 
business statistics, operational analysis and many more which it would be hard to 
catalogue. I have counted 14ft titles of his publications between 1922 and 1901—but 
another two busy years have now gone by and. in any case, wo all know how impos¬ 
sible it is to list accurately the whole of any writer's work, as the author himself often 
finds it a difficult job. 

The salient fact which emerges from scanning the list of subject headings so far 
classified is that here is a mind which is not only open to every branch of scientific 
research but which acknowledges the need for rigorous method and the practical 
value of the results achieved, with a feeling for figures and possibilities of error, and 
is at the same time concerned with finding new dcvico for investigation. 

His greatest work has been in the wide field of experimental estimates in 
agriculture — i.o. a subject which is of vital interest for developing countries liko 
India. But the variety of other important lines of research already mentioned should 
1)0 noted. It must be added, to complete the picture, that when Professor Mahalanobis 
takes up a new field of study ho dedicates the whole of his efforts to making a thorough 
investigation of it. He is no dilettant flitting from one thing to another, achieving 
nothing. 

At least two of his methodological contributions must bo recorded. One is 
the introduction of bis measurement of generalized distance in multivaricd analyses, 
the achievement of the solution of an old problem, probably encouraged above all 
by his studies on comparative anthropometry. The other is the development of, 
to some extent sequential, procedures for carrying out widespread sampling. This 
innovation is part of a series of improvements introduced in the course of important 
experimental and census research for coping with some of the fundamental problems 
of Indian life and economic development. If the country is now well equipped with 
men and means for carrying out every kind of sample surveying, thus helping enor¬ 
mously to pinpoint and settle many economic and social problems, this is largely due 
to Professor Mahalanobis and liis team of co-workers and followers. 

His tireless efforts on behalf of science and his country have led to a number 
of practical achievements. The first was the creation of the Indian Statistical Institute 
(1931) which, together with Sankhija : The Indian Journal of Statistics, started 
shortly afterwards (in 1933), formed the nucleus of a research movement bringing the 
Indian school of statistics into the top line. Mahalanobis’s work has not, however, 
been confined to India but has won general recognition in international circles. What 
he has written about the teaching of Statistics in various types of school is also import¬ 
ant and so is his educational work at the International Statistical Institute. 

His was the great merit of founding the International Statistical Education 
Centre in Calcutta in 1950, under the auspices of U.N.E.S.C.O. and the Indian 
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Government, which works in conjunction with the I.S.I. and the Indian Statistical 
Institute. This centre continues to meet its original aims of giving courses for 

(A) teachers of statistics, 

(B) officials without experience in statistical work. 

By the end of 1961, 378 pupils had been trained at the centre. 

As an outstanding Indian personality and as chairman of the Committee of 
Statistical Education of the Institute, Professor Mahalanobis has given a great boost 
to statistical education for many years. While he was chairman, other centres—at 
Beirut and for one year at Rome—were set up and worked well. 

This is not the place to list the numerous acknowledgements of Professor 
Mahalanobis' statistical work in India and elsewhere. His biography appears in 
A History of the Internatiorujl Statistical Institute by J. W. Nixon and tho 
International Who's Who contains a list of the distinctions he has won. Wo cannot, 
however, fail to mention the tribute paid him by one of tho oldest, and certainly 
the most famous, scientific societies in the world — by making him a Fellow of the 
Royal Society, London. 

The writer of this article is proud to have shared with Professor Mahalanobis 
the friendship of Sir Ronald Fisher. Now that we are celebrating tho Jubilee of the 
former, it is fitting to mention tho together, recalling tho memory of tho latter who 
has so recently departed from among us. Professor Mahalanobis and Sir Ronald 
were together elected honorary presidents of tho International Statistical Institute 
at Stockholm in 1957—a rare, if not unique, distinction which was intended as a 
solemn mark of our august assembly's appreciation of two such highly qualified men. 

I, as President of the Institute, would like to congratulate tho honorary 
president, Professor Mahalanobis, and add my tribute to those pouring in on tho 
occasion of his Jubilee. I would also like to express to him, and to Mrs. Mahalanobis 
who has been a valuable and constant companion in her husband's work and under¬ 
takings, as well as to their great country, the hone for a long life of useful activity 
by a great mind which, fortunately for us, is still going to achiove many things in 

the future. _ ., . . 

M. Doldnni 

President 


National Institute of Sciences of India 

On behalf of tho National Institute of Sciences I have pleasure in sending 
our felicitations and good wishes to Professor Mahalanobis on his seventieth birthday. 
Professor Mahalanobis has established the importance of Statistics in India in Govern¬ 
ment and National Planning. Through his achievements he has enhanced the prestige 
of Indian Science in other countries. We send him our best wishes for many years 
of continued fruitful activity. 


Ho mi Bhabha 
President 
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Patrice Lumumba University of Friendship among Peoples 

The great scientist and social worker of India, Professor P. C. Mahalanobis 
completed his 70th birthday on 29 June. His name is connected with the establish¬ 
ment and guidance of the many-sided activity of the Indian Statistical Institute wliieh 
is engaged in studying problems of physics and mathematics, meteorology and hydro¬ 
logy, anthropology and sociology, demography and economies. The contributions 
of Professor P. C. Mahalanobis in the domain of theoretical and applied statistics 
are of outstanding significance. 

The researches and practical operations conducted in the Institute and its 
different departments have not only theoretical scientific interest but also great practi¬ 
cal importance for the building up of an independent India. Organisation of teaching 
courses in the Institute and later of the International Statistical Education Centre 
havo ensured the training of highly qualified cadres of statisticians not only for India 
but also for several other countries in the East. 

From 1949 Professor Mahalanobis has been an honorary Adviser to the Cabi¬ 
net of Ministers in statistics and from 1955 he has been a mcml>cr of the Planning 
Commission of India holding the rank of a minister. 

A person of exceptional energy, initiative, outstanding organising talent, a 
blazing patriot of his mother country. Professor Mahalanobis has made great contri¬ 
butions to the establishment and expansion of the economic and scientific relations 
between India and the Soviet Union. He has visited tho U.S.S.R. a number of times 
and has lectured several times in the Academy of Sciences, U.S.S.R. of which he 
happens to be o foreign member, in the Moscow State University, the Patrice 
Lumumba University of Friendship among Peoples and in other educational 
institutions of the Soviet Union. 

On tho occasion of his 70th birthday his numerous Soviet friends and colleagues 
wish him sound health and long life for the progress of his inothor country and further 
strengthening the relations between India and the Soviet Union and for peace in tho 
whole world. 


P. Erzin 


The Royal Society, London 


Director 


The Royal Society of London joins in sending greetings to Professor Prasanta 
Chandra Mahalanobis, F.R.S., on the occasion of his seventieth birthday. 

Elected a Fellow of the Royal Society in 1945, Professor Mahalanobis is dis¬ 
tinguished for his outstanding contributions to statistical scienco. 


Professor Mahalanobis may look back with pride on a long and distinguished 
career. His colleagues in the Fellowship of the Royal Society wish him many more 
years of fruitful and happy activity. 


U. W. Florey 

President 
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Royal Statistical Society 


The Indian Statistical Institute has attained a remarkable reputation through¬ 
out the world, both for the depth of the theoretical research accomplished there, 


and the pertinent relation to current world problems of its applied statistical work. 
This arose almost entirely out of the initial energy and drive of one man—Prasanta 
Chandra Mahalanobis—whose seventieth birthday this volume commemorates. 


In the fields of mathematics, physics, anthropology, meteorology, agronomy, 
economics and statecraft Professor Mahalanobis has played a distinguished part. 
That he has been a Fellow of the Royal Society since 1045 and a Foreign Member 
of the U.S.S.R. Academy of Sciences since 1958 bears witness to his scientific versati¬ 
lity. We ourselves are proud to number him among our Honorary Fellows. 


The Royal Statistical Society congratulates Professor Mahalanobis and India 
on his seventieth birthday and wishes him many more years of useful activity. 


J. O. Irwin 
President 





